[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:44 dist-test-slave-68xk krb5kdc[24468](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:44 dist-test-slave-68xk krb5kdc[24468](info): set up 2 sockets
Aug 11 18:52:44 dist-test-slave-68xk krb5kdc[24468](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 18:52:45.958709 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:52:46.093945 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:44423
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:44423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:46.178933 24491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:46.179167 24491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:46.179189 24491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:46.180333 24491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:46.180377 24491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:46.180390 24491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:46.180404 24491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:46.180418 24491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:46.181867 24491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:44423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:44423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:46.182086 24491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:46.182273 24491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:46.187422 24499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:46.187422 24496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:46.187454 24497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:46.187788 24491 server_base.cc:1034] running on GCE node
I20260811 18:52:46.188068 24491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:46.188390 24491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:46.189596 24491 hybrid_clock.cc:648] HybridClock initialized: now 1786474366189613 us; error 85 us; skew 500 ppm
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:46.192698 24491 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:52:46.193209 24491 webserver.cc:460] Webserver started at http://127.23.226.254:40011/ using document root <none> and password file <none>
I20260811 18:52:46.193454 24491 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:46.193524 24491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:46.193686 24491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:46.194962 24491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "616827e868934a69a2d1b9defaa3c307"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "2a6ae200b788c00697addf20000b9c0e"
server_key_iv: "59af522db4cc2f8cb86c05f4ea7171b3"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.195367 24491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "616827e868934a69a2d1b9defaa3c307"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "2a6ae200b788c00697addf20000b9c0e"
server_key_iv: "59af522db4cc2f8cb86c05f4ea7171b3"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.196913 24491 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:52:46.197902 24513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.198192 24491 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:46.198319 24491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "616827e868934a69a2d1b9defaa3c307"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "2a6ae200b788c00697addf20000b9c0e"
server_key_iv: "59af522db4cc2f8cb86c05f4ea7171b3"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.198402 24491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:46.216018 24491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:46.218369 24491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:46.218654 24491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:46.223572 24491 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:44423
I20260811 18:52:46.223619 24601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:44423 every 8 connection(s)
I20260811 18:52:46.224150 24491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:46.225348 24602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:46.227856 24602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307: Bootstrap starting.
I20260811 18:52:46.228499 24602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:46.228834 24602 log.cc:824] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:46.229730 24602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307: No bootstrap required, opened a new log
I20260811 18:52:46.229751 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24491
I20260811 18:52:46.229830 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:52:46.230619 24459 external_mini_cluster.cc:1428] Setting key 0040c82a9da2ea2cbd87f50a2a21b624
I20260811 18:52:46.232066 24602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "616827e868934a69a2d1b9defaa3c307" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44423 } }
I20260811 18:52:46.232278 24602 raft_consensus.cc:374] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:46.232327 24602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616827e868934a69a2d1b9defaa3c307, State: Initialized, Role: FOLLOWER
I20260811 18:52:46.232519 24602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "616827e868934a69a2d1b9defaa3c307" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44423 } }
I20260811 18:52:46.232661 24602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:46.232724 24602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:46.232786 24602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:46.234165 24602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "616827e868934a69a2d1b9defaa3c307" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44423 } }
I20260811 18:52:46.234301 24602 leader_election.cc:302] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 616827e868934a69a2d1b9defaa3c307; no voters:
I20260811 18:52:46.234516 24602 leader_election.cc:288] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:46.234563 24609 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:46.234792 24609 raft_consensus.cc:686] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [term 1 LEADER]: Becoming Leader. State: Replica: 616827e868934a69a2d1b9defaa3c307, State: Running, Role: LEADER
I20260811 18:52:46.234848 24602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:46.234923 24609 consensus_queue.cc:237] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "616827e868934a69a2d1b9defaa3c307" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44423 } }
I20260811 18:52:46.235455 24610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "616827e868934a69a2d1b9defaa3c307" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "616827e868934a69a2d1b9defaa3c307" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44423 } } }
I20260811 18:52:46.235579 24610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:46.236080 24622 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:46.236718 24622 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:46.237946 24611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 616827e868934a69a2d1b9defaa3c307. Latest consensus state: current_term: 1 leader_uuid: "616827e868934a69a2d1b9defaa3c307" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "616827e868934a69a2d1b9defaa3c307" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44423 } } }
I20260811 18:52:46.238056 24611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:46.238722 24622 catalog_manager.cc:1347] Generated new cluster ID: 959375a57c2e4fb8a20509c181f341b9
I20260811 18:52:46.238775 24622 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:46.250993 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.231668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48858 (local address 127.23.226.254:44423)
0811 18:52:46.231903 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:46.231913 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:46.232334 (+ 421us) server_negotiation.cc:407] Connection header received
0811 18:52:46.235036 (+ 2702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:46.235043 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:46.235129 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:46.235338 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:46.237858 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.239442 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.240886 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.241647 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.241777 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.246308 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:46.246313 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:46.246313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:46.246327 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:46.248595 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.249186 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.249189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.249189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.249301 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.249622 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.249623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.249623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.249935 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:46.250105 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:46.250554 (+ 449us) server_negotiation.cc:299] Negotiation successful
0811 18:52:46.250715 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":106,"threads_started":1}
I20260811 18:52:46.267431 24622 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:46.268091 24622 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:46.274477 24622 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 616827e868934a69a2d1b9defaa3c307: Generated new TSK 0
I20260811 18:52:46.274739 24622 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:52:46.313227 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44423
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:46.398600 24640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:46.398806 24640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:46.398854 24640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:46.399963 24640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:46.400002 24640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:46.400029 24640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:52:46.401539 24640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44423
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:46.401733 24640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:46.401909 24640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:46.407469 24649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:46.407502 24647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:46.407476 24653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:46.407691 24640 server_base.cc:1034] running on GCE node
I20260811 18:52:46.407905 24640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:46.408144 24640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:46.409365 24640 hybrid_clock.cc:648] HybridClock initialized: now 1786474366409356 us; error 43 us; skew 500 ppm
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:46.412361 24640 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:52:46.412940 24640 webserver.cc:460] Webserver started at http://127.23.226.193:46407/ using document root <none> and password file <none>
I20260811 18:52:46.413254 24640 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:46.413337 24640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:46.413514 24640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:46.414791 24640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "18ca0611981a40398b598eddcd519caa"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f3448536597a14fcedbfe9a94b9efffc"
server_key_iv: "0283c9635e1e37a72610b8e9746b60f2"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.415215 24640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "18ca0611981a40398b598eddcd519caa"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f3448536597a14fcedbfe9a94b9efffc"
server_key_iv: "0283c9635e1e37a72610b8e9746b60f2"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.416747 24640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:52:46.417711 24671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.417927 24640 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:46.418049 24640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "18ca0611981a40398b598eddcd519caa"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f3448536597a14fcedbfe9a94b9efffc"
server_key_iv: "0283c9635e1e37a72610b8e9746b60f2"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.418169 24640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:46.429582 24640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:46.432200 24640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:46.432384 24640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:46.432642 24640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:46.433005 24640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:46.433063 24640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.433130 24640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:46.433161 24640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.440318 24640 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:42299
I20260811 18:52:46.440372 24852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:42299 every 8 connection(s)
I20260811 18:52:46.440701 24640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:46.449270 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24640
I20260811 18:52:46.449385 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:46.449608 24459 external_mini_cluster.cc:1428] Setting key d96eaf1c73503ed6c795c38361b4d5d6
I20260811 18:52:46.452194 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.441563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:50093 (local address 127.23.226.254:44423)
0811 18:52:46.441664 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:46.441667 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:46.441889 (+ 222us) server_negotiation.cc:407] Connection header received
0811 18:52:46.442552 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:46.442553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:46.442566 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:46.442634 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:46.443796 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.444299 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.445395 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.445629 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.445697 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.448350 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:46.448352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:46.448352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:46.448360 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:46.450237 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.450990 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.450992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.450992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.451056 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.451432 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.451434 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.451434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.451560 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:46.451621 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:46.452031 (+ 410us) server_negotiation.cc:299] Negotiation successful
0811 18:52:46.452123 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:52:46.452575 24856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.441530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44423 (local address 127.23.226.193:50093)
0811 18:52:46.441748 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:46.441788 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:46.442401 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:46.442732 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:46.442736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:46.443487 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:46.443705 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:46.443711 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.444385 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.444386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:46.445284 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:46.445286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.445729 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.445730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:46.445842 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.446682 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:46.446704 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:46.448245 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:46.450486 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:46.450496 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:46.450498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:46.450878 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:46.451141 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:46.451142 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:46.451142 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:46.451319 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:46.451637 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:46.451644 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:46.451837 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 18:52:46.451956 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 18:52:46.452159 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":96,"threads_started":1}
I20260811 18:52:46.453295 24853 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44423
I20260811 18:52:46.453394 24853 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:46.453617 24853 heartbeater.cc:511] Master 127.23.226.254:44423 requested a full tablet report, sending...
I20260811 18:52:46.454263 24538 ts_manager.cc:194] Registered new tserver with Master: 18ca0611981a40398b598eddcd519caa (127.23.226.193:42299)
I20260811 18:52:46.455250 24538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:50093
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:52:46.481772 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44423
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:46.570896 24861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:46.571105 24861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:46.571135 24861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:46.572570 24861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:46.572633 24861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:46.572666 24861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:52:46.574514 24861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44423
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:46.574792 24861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:46.575081 24861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:46.581043 24874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:46.581039 24869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:46.581110 24861 server_base.cc:1034] running on GCE node
W20260811 18:52:46.581034 24868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:46.581481 24861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:46.581827 24861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:46.583046 24861 hybrid_clock.cc:648] HybridClock initialized: now 1786474366583029 us; error 47 us; skew 500 ppm
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:46.585829 24861 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:52:46.586330 24861 webserver.cc:460] Webserver started at http://127.23.226.194:37207/ using document root <none> and password file <none>
I20260811 18:52:46.586592 24861 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:46.586668 24861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:46.586830 24861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:46.587980 24861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "65382f80269e40d5bd4b862da3c41082"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f012bdde34a81fa15bea55a51dbdbb10"
server_key_iv: "e2e0fd576c08fc0c8d425ab77a328aeb"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.588362 24861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "65382f80269e40d5bd4b862da3c41082"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f012bdde34a81fa15bea55a51dbdbb10"
server_key_iv: "e2e0fd576c08fc0c8d425ab77a328aeb"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.589802 24861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:52:46.590649 24886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.590945 24861 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:46.591089 24861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "65382f80269e40d5bd4b862da3c41082"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f012bdde34a81fa15bea55a51dbdbb10"
server_key_iv: "e2e0fd576c08fc0c8d425ab77a328aeb"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.591174 24861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:46.604169 24861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:46.606529 24861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:46.606716 24861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:46.607015 24861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:46.607398 24861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:46.607462 24861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.607501 24861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:46.607535 24861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.614629 24861 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:32943
I20260811 18:52:46.614712 25075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:32943 every 8 connection(s)
I20260811 18:52:46.615047 24861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:46.617954 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24861
I20260811 18:52:46.618049 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:46.618214 24459 external_mini_cluster.cc:1428] Setting key da3897f41e82358b71c07f8f3797913a
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:46.626775 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.615938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:47125 (local address 127.23.226.254:44423)
0811 18:52:46.616027 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:46.616029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:46.616245 (+ 216us) server_negotiation.cc:407] Connection header received
0811 18:52:46.616781 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:46.616782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:46.616793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:46.616848 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:46.617907 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.618720 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.619960 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.620281 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.620359 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.623156 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:46.623158 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:46.623159 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:46.623168 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:46.625082 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.625580 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.625582 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.625582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.625652 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.625923 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.625925 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.625926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.626088 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:46.626169 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:46.626547 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 18:52:46.626647 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:52:46.626921 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.615878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44423 (local address 127.23.226.194:47125)
0811 18:52:46.616093 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:46.616134 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:46.616690 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:46.616907 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:46.616911 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:46.617546 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:46.617777 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:46.617782 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.618822 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.618824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:46.619862 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:46.619866 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.620399 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.620400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:46.620529 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.621125 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:46.621135 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:46.623054 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:46.625229 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:46.625237 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:46.625239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:46.625496 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:46.625734 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:46.625735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:46.625735 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:46.625850 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:46.626202 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:46.626208 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:46.626342 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 18:52:46.626519 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 18:52:46.626692 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":107,"threads_started":1}
I20260811 18:52:46.627568 25077 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44423
I20260811 18:52:46.627674 25077 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:46.627928 25077 heartbeater.cc:511] Master 127.23.226.254:44423 requested a full tablet report, sending...
I20260811 18:52:46.628440 24538 ts_manager.cc:194] Registered new tserver with Master: 65382f80269e40d5bd4b862da3c41082 (127.23.226.194:32943)
I20260811 18:52:46.628978 24538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:47125
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:52:46.649477 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44423
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:46.736289 25083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:46.736573 25083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:46.736619 25083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:46.737778 25083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:46.737821 25083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:46.737849 25083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:52:46.739382 25083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44423
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:46.739637 25083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:46.739885 25083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:46.745025 25096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:46.745083 25101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:46.745141 25098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:46.745522 25083 server_base.cc:1034] running on GCE node
I20260811 18:52:46.745802 25083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:46.746094 25083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:46.747291 25083 hybrid_clock.cc:648] HybridClock initialized: now 1786474366747262 us; error 57 us; skew 500 ppm
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:46.750267 25083 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:52:46.750902 25083 webserver.cc:460] Webserver started at http://127.23.226.195:43011/ using document root <none> and password file <none>
I20260811 18:52:46.751185 25083 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:46.751268 25083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:46.751436 25083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:46.752604 25083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "c00b4d05282b40ac852b0cead803759e"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f326017d38451c6afa63548a8ec67fee"
server_key_iv: "39d5672a9c0a0c7861b17e6327e1baaa"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.753005 25083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "c00b4d05282b40ac852b0cead803759e"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f326017d38451c6afa63548a8ec67fee"
server_key_iv: "39d5672a9c0a0c7861b17e6327e1baaa"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.754563 25083 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:52:46.755403 25109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.755604 25083 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:46.755721 25083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "c00b4d05282b40ac852b0cead803759e"
format_stamp: "Formatted at 2026-08-11 18:52:46 on dist-test-slave-68xk"
server_key: "f326017d38451c6afa63548a8ec67fee"
server_key_iv: "39d5672a9c0a0c7861b17e6327e1baaa"
server_key_version: "encryptionkey@0"
I20260811 18:52:46.755812 25083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:46.773458 25083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:46.776219 25083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:46.776409 25083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:46.776679 25083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:46.777026 25083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:46.777068 25083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.777101 25083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:46.777146 25083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:46.784281 25083 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:34059
I20260811 18:52:46.784340 25297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:34059 every 8 connection(s)
I20260811 18:52:46.784716 25083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:46.784896 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25083
I20260811 18:52:46.784986 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:46.785216 24459 external_mini_cluster.cc:1428] Setting key d90c2b57126f3640d0497ea0a4ec55c4
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:46.795753 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.785855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:37299 (local address 127.23.226.254:44423)
0811 18:52:46.785913 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:46.785916 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:46.786256 (+ 340us) server_negotiation.cc:407] Connection header received
0811 18:52:46.786979 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:46.786980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:46.786992 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:46.787106 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:46.788132 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.788686 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.789823 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.790033 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.790140 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.792580 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:46.792582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:46.792582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:46.792590 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:46.794236 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.794744 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.794745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.794746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.794812 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.795077 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.795078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.795078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.795234 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:46.795294 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:46.795583 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 18:52:46.795664 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:52:46.795977 25307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.785870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44423 (local address 127.23.226.195:37299)
0811 18:52:46.786065 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:46.786145 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:46.786873 (+ 728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:46.787105 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:46.787108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:46.787788 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:46.788008 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:46.788014 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.788786 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.788787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:46.789719 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:46.789722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.790160 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.790161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:46.790274 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.790921 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:46.790930 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:46.792472 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:46.794335 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:46.794344 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:46.794346 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:46.794649 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:46.794889 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:46.794890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:46.794890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:46.795000 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:46.795299 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:46.795307 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:46.795444 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 18:52:46.795544 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:52:46.795719 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
I20260811 18:52:46.796515 25304 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44423
I20260811 18:52:46.796633 25304 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:46.796828 25304 heartbeater.cc:511] Master 127.23.226.254:44423 requested a full tablet report, sending...
I20260811 18:52:46.797274 24538 ts_manager.cc:194] Registered new tserver with Master: c00b4d05282b40ac852b0cead803759e (127.23.226.195:34059)
I20260811 18:52:46.797739 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:52:46.797737 24538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:37299
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:52:46.823946 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.814915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37460 (local address 127.23.226.193:42299)
0811 18:52:46.815105 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:46.815110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:46.815121 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:52:46.815149 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:46.815151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:46.815165 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:46.815241 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:46.815870 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.816720 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.817468 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.817802 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.817868 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.820539 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:46.820548 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:46.820548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:46.820556 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:46.822391 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.822980 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.822983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.822983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.823051 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.823347 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.823348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.823349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.823499 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:46.823619 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:46.823708 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 18:52:46.823795 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
W20260811 18:52:46.824452 24715 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37460
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[24468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:52:46.850378 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:46.842993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37476 (local address 127.23.226.193:42299)
0811 18:52:46.843063 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:46.843065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:46.843079 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:52:46.843164 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:46.843165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:46.843177 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:46.843228 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:46.843840 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.844322 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.845147 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:46.845351 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:46.845407 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:46.847993 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:46.847995 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:46.847995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:46.848002 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:46.849396 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.849729 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.849731 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.849731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.849792 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:46.849971 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:46.849972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:46.849972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:46.850072 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:46.850183 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:46.850239 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 18:52:46.850306 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:52:46.851059 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24640
I20260811 18:52:46.866575 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24861
I20260811 18:52:46.901014 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25083
I20260811 18:52:46.911800 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24491
2026-08-11T18:52:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2237 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[25326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[25326](info): set up 2 sockets
Aug 11 18:52:46 dist-test-slave-68xk krb5kdc[25326](info): commencing operation
krb5kdc: starting...
W20260811 18:52:48.171568 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:52:48.301107 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41115
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:32903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:41115
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:48.383008 25351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:48.383245 25351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:48.383294 25351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:48.384428 25351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:48.384492 25351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:48.384516 25351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:48.384536 25351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:48.384564 25351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:48.386019 25351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:32903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:41115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:48.386300 25351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:48.386543 25351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:48.391660 25362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:48.391673 25366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:48.391673 25361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:48.391867 25351 server_base.cc:1034] running on GCE node
I20260811 18:52:48.392146 25351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:48.392426 25351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:48.393584 25351 hybrid_clock.cc:648] HybridClock initialized: now 1786474368393559 us; error 44 us; skew 500 ppm
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:48.396034 25351 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:52:48.396478 25351 webserver.cc:460] Webserver started at http://127.23.226.254:32909/ using document root <none> and password file <none>
I20260811 18:52:48.396678 25351 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:48.396718 25351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:48.396814 25351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:48.397773 25351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "0ad2d9889906490684af3e9df37df8b2"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "72aff6c2daeaa53e4f032f9165728843"
server_key_iv: "b180fc458cf4d4b24e61f0a70ca40765"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.398073 25351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "0ad2d9889906490684af3e9df37df8b2"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "72aff6c2daeaa53e4f032f9165728843"
server_key_iv: "b180fc458cf4d4b24e61f0a70ca40765"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.399477 25351 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:52:48.400277 25375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.400483 25351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:52:48.400597 25351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "0ad2d9889906490684af3e9df37df8b2"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "72aff6c2daeaa53e4f032f9165728843"
server_key_iv: "b180fc458cf4d4b24e61f0a70ca40765"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.400674 25351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:48.409874 25351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:48.411801 25351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:48.411968 25351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:48.416599 25351 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:41115
I20260811 18:52:48.416718 25460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:41115 every 8 connection(s)
I20260811 18:52:48.417047 25351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:48.417972 25461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:48.420514 25461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2: Bootstrap starting.
I20260811 18:52:48.421175 25461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:48.421499 25461 log.cc:824] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:48.422278 25461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2: No bootstrap required, opened a new log
I20260811 18:52:48.424098 25461 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad2d9889906490684af3e9df37df8b2" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41115 } }
I20260811 18:52:48.424256 25461 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:48.424283 25461 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad2d9889906490684af3e9df37df8b2, State: Initialized, Role: FOLLOWER
I20260811 18:52:48.424443 25461 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad2d9889906490684af3e9df37df8b2" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41115 } }
I20260811 18:52:48.424525 25461 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:48.424568 25461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:48.424623 25461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:48.425242 25461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad2d9889906490684af3e9df37df8b2" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41115 } }
I20260811 18:52:48.425360 25461 leader_election.cc:302] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ad2d9889906490684af3e9df37df8b2; no voters:
I20260811 18:52:48.425556 25461 leader_election.cc:288] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:48.425619 25467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:48.425809 25467 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad2d9889906490684af3e9df37df8b2, State: Running, Role: LEADER
I20260811 18:52:48.425865 25461 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:48.425987 25467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad2d9889906490684af3e9df37df8b2" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41115 } }
I20260811 18:52:48.426455 25471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ad2d9889906490684af3e9df37df8b2. Latest consensus state: current_term: 1 leader_uuid: "0ad2d9889906490684af3e9df37df8b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad2d9889906490684af3e9df37df8b2" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41115 } } }
I20260811 18:52:48.426493 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25351
I20260811 18:52:48.426541 25471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:48.426604 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:52:48.426597 25470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ad2d9889906490684af3e9df37df8b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad2d9889906490684af3e9df37df8b2" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41115 } } }
I20260811 18:52:48.426656 25470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2 [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:48.426831 24459 external_mini_cluster.cc:1428] Setting key 5885dce8f0c08f14652905bb4f58a269
I20260811 18:52:48.427152 25478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:48.427752 25478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:48.429627 25478 catalog_manager.cc:1347] Generated new cluster ID: dae629a61d204c5ca6baf235a70d2687
I20260811 18:52:48.429685 25478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:48.439982 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:48.427566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53548 (local address 127.23.226.254:41115)
0811 18:52:48.427930 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:48.427939 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:48.427976 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:52:48.428114 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:48.428121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:48.428180 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:48.428309 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:48.429266 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.430707 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.431936 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.432549 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.432649 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:48.435736 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:48.435742 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:48.435743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:48.435762 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:48.438098 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.438554 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.438558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.438558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.438711 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.438928 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.438929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.438930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.439299 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:48.439476 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:48.439557 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 18:52:48.439730 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260811 18:52:48.448020 25478 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:48.448841 25478 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:48.452764 25478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ad2d9889906490684af3e9df37df8b2: Generated new TSK 0
I20260811 18:52:48.452960 25478 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:52:48.485929 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41115
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:32903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:48.570062 25509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:48.570266 25509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:48.570290 25509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:48.571517 25509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:48.571560 25509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:48.571587 25509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:52:48.573077 25509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:32903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41115
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:48.573318 25509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:48.573539 25509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:48.578476 25517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:48.578469 25518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:48.578555 25509 server_base.cc:1034] running on GCE node
W20260811 18:52:48.578469 25521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:48.578863 25509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:48.579052 25509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:48.580210 25509 hybrid_clock.cc:648] HybridClock initialized: now 1786474368580199 us; error 27 us; skew 500 ppm
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:48.588337 25509 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:52:48.588792 25509 webserver.cc:460] Webserver started at http://127.23.226.193:45823/ using document root <none> and password file <none>
I20260811 18:52:48.589020 25509 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:48.589085 25509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:48.589272 25509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:48.590332 25509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "111fb768c9404040b27b78d4510ebb37"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "fb055102b3f0959640bf6d48395847f7"
server_key_iv: "edce1412d8d7b8537931609d87ff2aa3"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.590744 25509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "111fb768c9404040b27b78d4510ebb37"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "fb055102b3f0959640bf6d48395847f7"
server_key_iv: "edce1412d8d7b8537931609d87ff2aa3"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.592170 25509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:48.592912 25530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.593082 25509 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:48.593221 25509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "111fb768c9404040b27b78d4510ebb37"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "fb055102b3f0959640bf6d48395847f7"
server_key_iv: "edce1412d8d7b8537931609d87ff2aa3"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.593303 25509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:48.618883 25509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:48.620910 25509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:48.621093 25509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:48.621387 25509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:48.621727 25509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:48.621781 25509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.621817 25509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:48.621860 25509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.628391 25509 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:44523
I20260811 18:52:48.628451 25707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:44523 every 8 connection(s)
I20260811 18:52:48.628783 25509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:48.631511 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25509
I20260811 18:52:48.631618 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:48.631800 24459 external_mini_cluster.cc:1428] Setting key d12f7b2899dabfbc6a95476213726ddd
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:48.639190 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:48.629524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:48847 (local address 127.23.226.254:41115)
0811 18:52:48.629571 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:48.629573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:48.629773 (+ 200us) server_negotiation.cc:407] Connection header received
0811 18:52:48.630875 (+ 1102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:48.630877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:48.630896 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:48.630953 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:48.631597 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.632292 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.633349 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.633568 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.633650 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:48.636105 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:48.636107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:48.636107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:48.636113 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:48.637525 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.638072 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.638073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.638073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.638126 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.638467 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.638468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.638469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.638572 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:48.638627 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:48.639022 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 18:52:48.639101 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:52:48.639417 25711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:48.629481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41115 (local address 127.23.226.193:48847)
0811 18:52:48.629637 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:48.629681 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:48.630756 (+ 1075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:48.631029 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:48.631034 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:48.631302 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:48.631499 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:48.631504 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.632384 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.632385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:48.633260 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:48.633263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.633662 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.633663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:48.633793 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:48.634337 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:48.634346 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:48.636000 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:48.637641 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:48.637649 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:48.637651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:48.637995 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:48.638193 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:48.638194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:48.638195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:48.638358 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:48.638642 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:48.638650 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:48.638832 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 18:52:48.638953 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 18:52:48.639153 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260811 18:52:48.639952 25708 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41115
I20260811 18:52:48.640064 25708 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:48.640254 25708 heartbeater.cc:511] Master 127.23.226.254:41115 requested a full tablet report, sending...
I20260811 18:52:48.640857 25405 ts_manager.cc:194] Registered new tserver with Master: 111fb768c9404040b27b78d4510ebb37 (127.23.226.193:44523)
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
I20260811 18:52:48.641549 25405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:48847
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:52:48.658309 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41115
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:32903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:48.742672 25717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:48.742885 25717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:48.742910 25717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:48.744011 25717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:48.744045 25717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:48.744071 25717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:52:48.745508 25717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:32903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41115
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:48.745695 25717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:48.745878 25717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:48.750705 25723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:48.750717 25725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:48.750950 25722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:48.750927 25717 server_base.cc:1034] running on GCE node
I20260811 18:52:48.751204 25717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:48.751410 25717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:48.752576 25717 hybrid_clock.cc:648] HybridClock initialized: now 1786474368752560 us; error 30 us; skew 500 ppm
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:48.755138 25717 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:52:48.755609 25717 webserver.cc:460] Webserver started at http://127.23.226.194:40329/ using document root <none> and password file <none>
I20260811 18:52:48.755801 25717 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:48.755842 25717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:48.755928 25717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:48.756873 25717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "33dd29349ad54354adcd89db72cdfdbe"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "3dcaca3380a805e62ad6f656bc01b284"
server_key_iv: "b9ad697dbbca755e17d8b22349c7f7f5"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.757167 25717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "33dd29349ad54354adcd89db72cdfdbe"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "3dcaca3380a805e62ad6f656bc01b284"
server_key_iv: "b9ad697dbbca755e17d8b22349c7f7f5"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.758493 25717 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:52:48.759195 25734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.759379 25717 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:48.759470 25717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "33dd29349ad54354adcd89db72cdfdbe"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "3dcaca3380a805e62ad6f656bc01b284"
server_key_iv: "b9ad697dbbca755e17d8b22349c7f7f5"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.759541 25717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:48.798275 25717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:48.800637 25717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:48.800827 25717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:48.801098 25717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:48.801458 25717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:48.801517 25717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.801560 25717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:48.801587 25717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.808061 25717 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:38767
I20260811 18:52:48.808115 25915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:38767 every 8 connection(s)
I20260811 18:52:48.808462 25717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:48.813439 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25717
I20260811 18:52:48.813515 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:48.813656 24459 external_mini_cluster.cc:1428] Setting key 17e0e019aa822fcc00fcdc7c962b98ae
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:48.819082 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:48.809278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:59135 (local address 127.23.226.254:41115)
0811 18:52:48.809346 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:48.809348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:48.809539 (+ 191us) server_negotiation.cc:407] Connection header received
0811 18:52:48.810542 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:48.810543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:48.810554 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:48.810613 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:48.811222 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.811713 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.812941 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.813122 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.813176 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:48.816048 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:48.816050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:48.816050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:48.816057 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:48.817659 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.818086 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.818087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.818088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.818154 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.818404 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.818405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.818406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.818546 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:48.818626 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:48.818899 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 18:52:48.818995 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:52:48.819267 25920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:48.809230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41115 (local address 127.23.226.194:59135)
0811 18:52:48.809404 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:48.809448 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:48.810393 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:48.810672 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:48.810676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:48.810941 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:48.811136 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:48.811140 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.811797 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.811798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:48.812639 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:48.812641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.813217 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.813218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:48.813342 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:48.814047 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:48.814058 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:48.815955 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:48.817767 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:48.817774 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:48.817776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:48.817999 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:48.818222 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:48.818223 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:48.818223 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:48.818334 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:48.818615 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:48.818622 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:48.818755 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 18:52:48.818864 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 18:52:48.819027 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260811 18:52:48.819746 25916 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41115
I20260811 18:52:48.819839 25916 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:48.820032 25916 heartbeater.cc:511] Master 127.23.226.254:41115 requested a full tablet report, sending...
I20260811 18:52:48.820436 25405 ts_manager.cc:194] Registered new tserver with Master: 33dd29349ad54354adcd89db72cdfdbe (127.23.226.194:38767)
I20260811 18:52:48.820989 25405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:59135
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:52:48.842720 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41115
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:32903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:48.926383 25927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:48.926688 25927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:48.926730 25927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:48.928097 25927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:48.928154 25927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:48.928201 25927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:52:48.929719 25927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:32903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41115
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:48.929996 25927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:48.930229 25927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:48.935204 25941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:48.935195 25936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:48.935240 25937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:48.935549 25927 server_base.cc:1034] running on GCE node
I20260811 18:52:48.935782 25927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:48.936021 25927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:48.937184 25927 hybrid_clock.cc:648] HybridClock initialized: now 1786474368937168 us; error 33 us; skew 500 ppm
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:48.939885 25927 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:52:48.940315 25927 webserver.cc:460] Webserver started at http://127.23.226.195:44135/ using document root <none> and password file <none>
I20260811 18:52:48.940537 25927 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:48.940603 25927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:48.940755 25927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:48.941787 25927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "881f361d91ad49e4b72dfe287c9c8dd6"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "512a7e0786c53b98977b7c5c361975f1"
server_key_iv: "bdc433c36a9370fd1fac6760e01d9a9f"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.942155 25927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "881f361d91ad49e4b72dfe287c9c8dd6"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "512a7e0786c53b98977b7c5c361975f1"
server_key_iv: "bdc433c36a9370fd1fac6760e01d9a9f"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.943559 25927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:52:48.944271 25952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.944440 25927 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.944538 25927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "881f361d91ad49e4b72dfe287c9c8dd6"
format_stamp: "Formatted at 2026-08-11 18:52:48 on dist-test-slave-68xk"
server_key: "512a7e0786c53b98977b7c5c361975f1"
server_key_iv: "bdc433c36a9370fd1fac6760e01d9a9f"
server_key_version: "encryptionkey@0"
I20260811 18:52:48.944618 25927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:48.965889 25927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:48.967882 25927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:48.968046 25927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:48.968283 25927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:48.968590 25927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:48.968642 25927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.968705 25927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:48.968737 25927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:48.974547 25927 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:35793
I20260811 18:52:48.974624 26131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:35793 every 8 connection(s)
I20260811 18:52:48.974958 25927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:48.978138 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25927
I20260811 18:52:48.978237 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:48.978399 24459 external_mini_cluster.cc:1428] Setting key 7b00542dacef11b2bd5156761c335fdb
Aug 11 18:52:48 dist-test-slave-68xk krb5kdc[25326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:48.984898 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:48.975754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:39035 (local address 127.23.226.254:41115)
0811 18:52:48.975836 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:48.975839 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:48.976014 (+ 175us) server_negotiation.cc:407] Connection header received
0811 18:52:48.976999 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:48.977000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:48.977015 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:48.977067 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:48.977741 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.978411 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.979741 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.979935 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.979993 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:48.982202 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:48.982203 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:48.982204 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:48.982211 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:48.983495 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.983943 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.983944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.983945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.984005 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.984255 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.984256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.984256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.984374 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:48.984445 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:48.984722 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 18:52:48.984804 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:52:48.985114 26135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:48.975648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41115 (local address 127.23.226.195:39035)
0811 18:52:48.975873 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:48.975927 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:48.976877 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:48.977181 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:48.977184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:48.977446 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:48.977645 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:48.977649 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.978557 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.978558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:48.979667 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:48.979671 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.980015 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.980016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:48.980115 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:48.980640 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:48.980648 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:48.982058 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:48.983612 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:48.983619 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:48.983622 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:48.983850 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:48.984073 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:48.984074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:48.984074 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:48.984188 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:48.984449 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:48.984457 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:48.984591 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 18:52:48.984697 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:52:48.984866 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":110,"threads_started":1}
I20260811 18:52:48.985757 26132 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41115
I20260811 18:52:48.985857 26132 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:48.986003 26132 heartbeater.cc:511] Master 127.23.226.254:41115 requested a full tablet report, sending...
I20260811 18:52:48.986394 25405 ts_manager.cc:194] Registered new tserver with Master: 881f361d91ad49e4b72dfe287c9c8dd6 (127.23.226.195:35793)
I20260811 18:52:48.986821 25405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:39035
I20260811 18:52:48.990614 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:52:48.998364 25502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:48.992134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53554 (local address 127.23.226.254:41115)
0811 18:52:48.992233 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:48.992236 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:48.992301 (+ 65us) server_negotiation.cc:407] Connection header received
0811 18:52:48.992373 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:48.992374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:48.992384 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:48.992440 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:48.993004 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.993482 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.994204 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:48.994408 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:48.994538 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:48.995749 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:48.995751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:48.995751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:48.995759 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:48.997201 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.997553 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.997554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.997555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.997610 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:48.997813 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:48.997814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:48.997815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:48.997963 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:48.998068 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:48.998183 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 18:52:48.998262 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:52:49.000470 25405 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:49.002007 25405 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:49.010196 26151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.004380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:35793 (local address 127.0.0.1:38432)
0811 18:52:49.005306 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:49.005316 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:49.005367 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:49.005837 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:49.005839 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:49.005841 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:49.005899 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.005900 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.007248 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.007249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.008861 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.008864 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.009879 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.009880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.009966 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.009982 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 18:52:49.010047 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 18:52:49.010103 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"mutex_wait_us":162,"thread_start_us":104,"threads_started":1}
I20260811 18:52:49.010468 26162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.004825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38432 (local address 127.23.226.195:35793)
0811 18:52:49.005053 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:49.005057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:49.005623 (+ 566us) server_negotiation.cc:407] Connection header received
0811 18:52:49.005732 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:49.005734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:49.005753 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:49.005823 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:49.005985 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.007136 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.008962 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.009690 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.009775 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.009838 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:49.010324 (+ 486us) server_negotiation.cc:299] Negotiation successful
0811 18:52:49.010372 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260811 18:52:49.010754 26157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.004380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:44523 (local address 127.0.0.1:57084)
0811 18:52:49.005052 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:49.005106 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:49.005190 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:49.005440 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:49.005444 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:49.005447 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:49.005554 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.005557 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.007673 (+ 2116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.007674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.009331 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.009335 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.010529 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.010530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.010591 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.010594 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:52:49.010643 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 18:52:49.010686 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":1111,"threads_started":1}
I20260811 18:52:49.010861 26155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.004637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33610 (local address 127.23.226.194:38767)
0811 18:52:49.004978 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:49.004982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:49.006006 (+ 1024us) server_negotiation.cc:407] Connection header received
0811 18:52:49.006128 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:49.006130 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:49.006145 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:49.006196 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:49.006458 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.007458 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.009060 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.009775 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.009818 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.009860 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:49.010739 (+ 879us) server_negotiation.cc:299] Negotiation successful
0811 18:52:49.010786 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":74,"threads_started":1}
I20260811 18:52:49.011039 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.004596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57084 (local address 127.23.226.193:44523)
0811 18:52:49.004863 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:49.004870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:49.005177 (+ 307us) server_negotiation.cc:407] Connection header received
0811 18:52:49.005287 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:49.005290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:49.005307 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:49.005380 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:49.005716 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.007489 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.009438 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.010215 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.010269 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.010318 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:49.010914 (+ 596us) server_negotiation.cc:299] Negotiation successful
0811 18:52:49.010961 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":104,"threads_started":1}
I20260811 18:52:49.011178 26027 tablet_service.cc:1467] Processing CreateTablet for tablet c15967583d0b4c799bc00ae3427ca871 (DEFAULT_TABLE table=test-table [id=953a68417739466ebbc5014b2da60629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:49.011472 26163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.004406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:38767 (local address 127.0.0.1:33610)
0811 18:52:49.005937 (+ 1531us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:49.005947 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:49.006036 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:49.006323 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:49.006324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:49.006326 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:49.006360 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.006362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.007756 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.007757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.008956 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.008958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.010171 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.010172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.010239 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.010243 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:52:49.011315 (+ 1072us) client_negotiation.cc:240] Negotiation successful
0811 18:52:49.011406 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1517,"mutex_wait_us":78,"thread_start_us":452,"threads_started":1}
I20260811 18:52:49.011576 26027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c15967583d0b4c799bc00ae3427ca871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:49.011690 25601 tablet_service.cc:1467] Processing CreateTablet for tablet c15967583d0b4c799bc00ae3427ca871 (DEFAULT_TABLE table=test-table [id=953a68417739466ebbc5014b2da60629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:49.012105 25601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c15967583d0b4c799bc00ae3427ca871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:49.012495 25809 tablet_service.cc:1467] Processing CreateTablet for tablet c15967583d0b4c799bc00ae3427ca871 (DEFAULT_TABLE table=test-table [id=953a68417739466ebbc5014b2da60629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:49.012831 25809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c15967583d0b4c799bc00ae3427ca871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:49.014456 26164 tablet_bootstrap.cc:492] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6: Bootstrap starting.
I20260811 18:52:49.015045 26164 tablet_bootstrap.cc:654] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:49.015568 26164 log.cc:824] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:49.016258 26173 tablet_bootstrap.cc:492] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe: Bootstrap starting.
I20260811 18:52:49.016389 26164 tablet_bootstrap.cc:492] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6: No bootstrap required, opened a new log
I20260811 18:52:49.016460 26164 ts_tablet_manager.cc:1397] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:49.016855 26173 tablet_bootstrap.cc:654] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:49.017349 26173 log.cc:824] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:49.017932 26164 raft_consensus.cc:348] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.018080 26173 tablet_bootstrap.cc:492] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe: No bootstrap required, opened a new log
I20260811 18:52:49.018090 26164 raft_consensus.cc:374] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:49.018133 26164 raft_consensus.cc:729] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 881f361d91ad49e4b72dfe287c9c8dd6, State: Initialized, Role: FOLLOWER
I20260811 18:52:49.018155 26173 ts_tablet_manager.cc:1397] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:49.018245 26164 consensus_queue.cc:260] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.016016 26172 tablet_bootstrap.cc:492] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37: Bootstrap starting.
I20260811 18:52:49.018564 26164 ts_tablet_manager.cc:1428] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 18:52:49.018703 26132 heartbeater.cc:503] Master 127.23.226.254:41115 was elected leader, sending a full tablet report...
I20260811 18:52:49.019143 26172 tablet_bootstrap.cc:654] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:49.019728 26172 log.cc:824] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:49.020185 26173 raft_consensus.cc:348] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.020364 26173 raft_consensus.cc:374] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:49.020392 26173 raft_consensus.cc:729] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33dd29349ad54354adcd89db72cdfdbe, State: Initialized, Role: FOLLOWER
I20260811 18:52:49.020498 26173 consensus_queue.cc:260] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.020588 26172 tablet_bootstrap.cc:492] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37: No bootstrap required, opened a new log
I20260811 18:52:49.020656 26172 ts_tablet_manager.cc:1397] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 18:52:49.020784 26173 ts_tablet_manager.cc:1428] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:52:49.020784 25916 heartbeater.cc:503] Master 127.23.226.254:41115 was elected leader, sending a full tablet report...
I20260811 18:52:49.022652 26172 raft_consensus.cc:348] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.022800 26172 raft_consensus.cc:374] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:49.022847 26172 raft_consensus.cc:729] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 111fb768c9404040b27b78d4510ebb37, State: Initialized, Role: FOLLOWER
I20260811 18:52:49.022954 26172 consensus_queue.cc:260] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.023205 26172 ts_tablet_manager.cc:1428] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:52:49.023291 25708 heartbeater.cc:503] Master 127.23.226.254:41115 was elected leader, sending a full tablet report...
W20260811 18:52:49.059115 25918 tablet.cc:2369] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:49.126133 26181 raft_consensus.cc:482] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:49.126329 26181 raft_consensus.cc:504] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.126801 26181 leader_election.cc:288] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 111fb768c9404040b27b78d4510ebb37 (127.23.226.193:44523), 881f361d91ad49e4b72dfe287c9c8dd6 (127.23.226.195:35793)
W20260811 18:52:49.129560 25710 tablet.cc:2369] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:49.129658 25920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.127015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:44523 (local address 127.23.226.194:58125)
0811 18:52:49.127087 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:49.127100 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:49.127145 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:49.127323 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:49.127324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:49.127327 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:49.127405 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.127407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.128047 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.128048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.128824 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.128826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.129382 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.129384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.129481 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.129485 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:52:49.129539 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:52:49.129587 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 18:52:49.129693 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.127084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:58125 (local address 127.23.226.193:44523)
0811 18:52:49.127129 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:49.127132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:49.127141 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:52:49.127214 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:49.127215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:49.127225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:49.127301 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:49.127492 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.127969 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.128919 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.129295 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.129374 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.129384 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:49.129570 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 18:52:49.129625 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:52:49.129925 26162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.127193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:52399 (local address 127.23.226.195:35793)
0811 18:52:49.127252 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:49.127254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:49.127421 (+ 167us) server_negotiation.cc:407] Connection header received
0811 18:52:49.127493 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:49.127494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:49.127502 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:49.127543 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:49.127705 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.128176 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.129093 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.129487 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.129578 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.129585 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:49.129808 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 18:52:49.129853 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:52:49.130002 25634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c15967583d0b4c799bc00ae3427ca871" candidate_uuid: "33dd29349ad54354adcd89db72cdfdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "111fb768c9404040b27b78d4510ebb37" is_pre_election: true
I20260811 18:52:49.130122 26188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.127106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:35793 (local address 127.23.226.194:52399)
0811 18:52:49.127346 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:49.127355 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:49.127426 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:49.127556 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:49.127556 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:49.127558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:49.127638 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.127640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.128261 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.128263 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.129003 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:49.129005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.129633 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.129634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:49.129711 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.129716 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:52:49.130001 (+ 285us) client_negotiation.cc:240] Negotiation successful
0811 18:52:49.130045 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":176,"threads_started":1}
I20260811 18:52:49.130164 25634 raft_consensus.cc:2454] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33dd29349ad54354adcd89db72cdfdbe in term 0.
I20260811 18:52:49.130441 25740 leader_election.cc:302] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 111fb768c9404040b27b78d4510ebb37, 33dd29349ad54354adcd89db72cdfdbe; no voters:
I20260811 18:52:49.130488 26064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c15967583d0b4c799bc00ae3427ca871" candidate_uuid: "33dd29349ad54354adcd89db72cdfdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" is_pre_election: true
I20260811 18:52:49.130581 26181 raft_consensus.cc:2781] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:49.130637 26181 raft_consensus.cc:482] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:49.130673 26181 raft_consensus.cc:3037] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:49.130661 26064 raft_consensus.cc:2454] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33dd29349ad54354adcd89db72cdfdbe in term 0.
I20260811 18:52:49.131444 26181 raft_consensus.cc:504] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.131589 26181 leader_election.cc:288] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [CANDIDATE]: Term 1 election: Requested vote from peers 111fb768c9404040b27b78d4510ebb37 (127.23.226.193:44523), 881f361d91ad49e4b72dfe287c9c8dd6 (127.23.226.195:35793)
I20260811 18:52:49.131739 25634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c15967583d0b4c799bc00ae3427ca871" candidate_uuid: "33dd29349ad54354adcd89db72cdfdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "111fb768c9404040b27b78d4510ebb37"
I20260811 18:52:49.131796 26064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c15967583d0b4c799bc00ae3427ca871" candidate_uuid: "33dd29349ad54354adcd89db72cdfdbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "881f361d91ad49e4b72dfe287c9c8dd6"
I20260811 18:52:49.131834 25634 raft_consensus.cc:3037] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:49.131866 26064 raft_consensus.cc:3037] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:49.132723 26064 raft_consensus.cc:2454] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33dd29349ad54354adcd89db72cdfdbe in term 1.
I20260811 18:52:49.132723 25634 raft_consensus.cc:2454] T c15967583d0b4c799bc00ae3427ca871 P 111fb768c9404040b27b78d4510ebb37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33dd29349ad54354adcd89db72cdfdbe in term 1.
I20260811 18:52:49.132912 25740 leader_election.cc:302] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 111fb768c9404040b27b78d4510ebb37, 33dd29349ad54354adcd89db72cdfdbe; no voters:
I20260811 18:52:49.133029 26181 raft_consensus.cc:2781] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:49.133234 26181 raft_consensus.cc:686] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [term 1 LEADER]: Becoming Leader. State: Replica: 33dd29349ad54354adcd89db72cdfdbe, State: Running, Role: LEADER
I20260811 18:52:49.133378 26181 consensus_queue.cc:237] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } }
I20260811 18:52:49.134238 25405 catalog_manager.cc:5495] T c15967583d0b4c799bc00ae3427ca871 P 33dd29349ad54354adcd89db72cdfdbe reported cstate change: term changed from 0 to 1, leader changed from <none> to 33dd29349ad54354adcd89db72cdfdbe (127.23.226.194). New cstate: current_term: 1 leader_uuid: "33dd29349ad54354adcd89db72cdfdbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "111fb768c9404040b27b78d4510ebb37" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "881f361d91ad49e4b72dfe287c9c8dd6" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 35793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33dd29349ad54354adcd89db72cdfdbe" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 38767 } health_report { overall_health: HEALTHY } } }
Aug 11 18:52:49 dist-test-slave-68xk krb5kdc[25326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:52:49.158207 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.150930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57096 (local address 127.23.226.193:44523)
0811 18:52:49.150993 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:49.150995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:49.151111 (+ 116us) server_negotiation.cc:407] Connection header received
0811 18:52:49.151182 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:49.151183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:49.151194 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:49.151249 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:49.151814 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.152267 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.152992 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.153178 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.153251 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.155538 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:49.155549 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:49.155549 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:49.155557 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:49.157031 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:49.157383 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:49.157388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:49.157388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:49.157455 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:49.157647 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:49.157649 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:49.157649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:49.157800 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:49.157960 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:49.158024 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 18:52:49.158107 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 18:52:49 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474369, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:52:49 dist-test-slave-68xk krb5kdc[25326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474369, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:52:49.182024 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.175309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57104 (local address 127.23.226.193:44523)
0811 18:52:49.175393 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:49.175396 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:49.175480 (+ 84us) server_negotiation.cc:407] Connection header received
0811 18:52:49.175572 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:49.175573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:49.175584 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:49.175636 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:49.176201 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.176670 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.177387 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.177595 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.177670 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.179912 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:49.179913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:49.179913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:49.179920 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:49.181105 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:49.181405 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:49.181406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:49.181406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:49.181454 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:49.181607 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:49.181607 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:49.181607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:49.181690 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:49.181771 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:49.181896 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 18:52:49.181959 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 18:52:49 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474369, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:52:49 dist-test-slave-68xk krb5kdc[25326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474369, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:52:49.206717 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:49.199004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57110 (local address 127.23.226.193:44523)
0811 18:52:49.199077 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:49.199079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:49.199141 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:52:49.199231 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:49.199232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:49.199242 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:49.199299 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:49.199894 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.200404 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.201226 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:49.201404 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:49.201460 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:49.204333 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:49.204334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:49.204335 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:49.204342 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:49.205674 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:49.206011 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:49.206012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:49.206013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:49.206072 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:49.206270 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:49.206271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:49.206271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:49.206363 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:49.206505 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:49.206591 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 18:52:49.206652 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 18:52:49.207221 25570 tablet_service.cc:2908] Rejecting scan request for tablet c15967583d0b4c799bc00ae3427ca871: Uninitialized: clean time has not yet been initialized
I20260811 18:52:49.208079 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25509
I20260811 18:52:49.224045 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25717
W20260811 18:52:49.225641 26134 tablet.cc:2369] T c15967583d0b4c799bc00ae3427ca871 P 881f361d91ad49e4b72dfe287c9c8dd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:49.233836 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25927
I20260811 18:52:49.241833 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25351
2026-08-11T18:52:49Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2327 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:49 dist-test-slave-68xk krb5kdc[26216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:49 dist-test-slave-68xk krb5kdc[26216](info): set up 2 sockets
Aug 11 18:52:49 dist-test-slave-68xk krb5kdc[26216](info): commencing operation
krb5kdc: starting...
W20260811 18:52:50.480787 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:52:50 dist-test-slave-68xk krb5kdc[26216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:52:50.611662 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41399
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:41399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:50.694514 26242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:50.694726 26242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:50.694772 26242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:50.695931 26242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:50.695992 26242 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:52:50.696018 26242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:50.696049 26242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:50.696074 26242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:50.696098 26242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:50.697554 26242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:41399
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:50.697824 26242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:50.698050 26242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:50.702687 26253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:50.702744 26247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:50.702751 26248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:50.703120 26242 server_base.cc:1034] running on GCE node
I20260811 18:52:50.703361 26242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:50.703622 26242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:50.704782 26242 hybrid_clock.cc:648] HybridClock initialized: now 1786474370704759 us; error 36 us; skew 500 ppm
Aug 11 18:52:50 dist-test-slave-68xk krb5kdc[26216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474370, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:50.707894 26242 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:52:50.708326 26242 webserver.cc:460] Webserver started at http://127.23.226.254:42201/ using document root <none> and password file <none>
I20260811 18:52:50.708549 26242 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:50.708593 26242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:50.708700 26242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:50.709831 26242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "ef1313550f3341b089cfdb0bea9ef59d"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-68xk"
server_key: "42cc1da77cdc27b8c702513ffac03261"
server_key_iv: "aab43985633040a41d018cf48588c2cf"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.710171 26242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "ef1313550f3341b089cfdb0bea9ef59d"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-68xk"
server_key: "42cc1da77cdc27b8c702513ffac03261"
server_key_iv: "aab43985633040a41d018cf48588c2cf"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.711649 26242 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:52:50.712387 26262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:50.712563 26242 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:50.712682 26242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "ef1313550f3341b089cfdb0bea9ef59d"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-68xk"
server_key: "42cc1da77cdc27b8c702513ffac03261"
server_key_iv: "aab43985633040a41d018cf48588c2cf"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.712762 26242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:50.728766 26242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:50.731374 26242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:50.731552 26242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:50.737092 26242 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:41399
I20260811 18:52:50.737150 26359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:41399 every 8 connection(s)
I20260811 18:52:50.737509 26242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:50.738183 26360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:50.740619 26360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d: Bootstrap starting.
I20260811 18:52:50.741248 26360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:50.741542 26360 log.cc:824] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:50.742309 26360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d: No bootstrap required, opened a new log
I20260811 18:52:50.744668 26360 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1313550f3341b089cfdb0bea9ef59d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41399 } }
I20260811 18:52:50.744835 26360 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:50.744884 26360 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1313550f3341b089cfdb0bea9ef59d, State: Initialized, Role: FOLLOWER
I20260811 18:52:50.745060 26360 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1313550f3341b089cfdb0bea9ef59d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41399 } }
I20260811 18:52:50.745167 26360 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:50.745215 26360 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:50.745267 26360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:50.745862 26360 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1313550f3341b089cfdb0bea9ef59d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41399 } }
I20260811 18:52:50.745978 26360 leader_election.cc:302] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef1313550f3341b089cfdb0bea9ef59d; no voters:
I20260811 18:52:50.746160 26360 leader_election.cc:288] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:50.746189 26369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:50.746361 26369 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [term 1 LEADER]: Becoming Leader. State: Replica: ef1313550f3341b089cfdb0bea9ef59d, State: Running, Role: LEADER
I20260811 18:52:50.746471 26360 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:50.746484 26369 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1313550f3341b089cfdb0bea9ef59d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41399 } }
I20260811 18:52:50.747066 26372 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef1313550f3341b089cfdb0bea9ef59d. Latest consensus state: current_term: 1 leader_uuid: "ef1313550f3341b089cfdb0bea9ef59d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1313550f3341b089cfdb0bea9ef59d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41399 } } }
I20260811 18:52:50.747181 26372 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:50.747187 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26242
I20260811 18:52:50.747282 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:52:50.747375 26370 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef1313550f3341b089cfdb0bea9ef59d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1313550f3341b089cfdb0bea9ef59d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41399 } } }
I20260811 18:52:50.747454 24459 external_mini_cluster.cc:1428] Setting key 68e6378d56f60d92ed287b15d0ea184b
I20260811 18:52:50.747450 26370 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:50.747903 26381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:50.748483 26381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:50.750044 26381 catalog_manager.cc:1347] Generated new cluster ID: c3263c5746d0481790e6a0a87c745c3c
I20260811 18:52:50.750101 26381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:52:50 dist-test-slave-68xk krb5kdc[26216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:50.759889 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:50.748098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54794 (local address 127.23.226.254:41399)
0811 18:52:50.748259 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:50.748270 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:50.748360 (+ 90us) server_negotiation.cc:407] Connection header received
0811 18:52:50.748533 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:50.748542 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:50.748604 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:50.749536 (+ 932us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:50.749642 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.750976 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.752059 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.752654 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.752758 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:50.755647 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:50.755653 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:50.755653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:50.755669 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:50.757928 (+ 2259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:50.758352 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:50.758357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:50.758357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:50.758536 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:50.758764 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:50.758766 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:50.758766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:50.759153 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:50.759338 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:50.759419 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 18:52:50.759624 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260811 18:52:50.770135 26381 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:50.770744 26381 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:50.774441 26381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d: Generated new TSK 0
I20260811 18:52:50.774644 26381 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:52:50.806999 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41399
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:50.890990 26409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:50.891228 26409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:50.891278 26409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:50.892462 26409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:50.892526 26409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:50.892560 26409 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:52:50.892602 26409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:52:50.894064 26409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:41399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:50.894343 26409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:50.894605 26409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:50.899708 26419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:50.899708 26416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:50.899855 26417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:50.899916 26409 server_base.cc:1034] running on GCE node
I20260811 18:52:50.900098 26409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:50.900370 26409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:50.901540 26409 hybrid_clock.cc:648] HybridClock initialized: now 1786474370901531 us; error 38 us; skew 500 ppm
Aug 11 18:52:50 dist-test-slave-68xk krb5kdc[26216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474370, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:50.904201 26409 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:52:50.904695 26409 webserver.cc:460] Webserver started at http://127.23.226.193:42797/ using document root <none> and password file <none>
I20260811 18:52:50.904948 26409 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:50.905018 26409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:50.905174 26409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:50.906203 26409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "02b373569e464a0690c66b6d6ce3beae"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-68xk"
server_key: "2e845368e9085f7249401bf71c8f6529"
server_key_iv: "22ca4fc69728561d694ff5c3fbbbd997"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.906589 26409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "02b373569e464a0690c66b6d6ce3beae"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-68xk"
server_key: "2e845368e9085f7249401bf71c8f6529"
server_key_iv: "22ca4fc69728561d694ff5c3fbbbd997"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.907954 26409 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:52:50.908737 26435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:50.908921 26409 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:52:50.909026 26409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "02b373569e464a0690c66b6d6ce3beae"
format_stamp: "Formatted at 2026-08-11 18:52:50 on dist-test-slave-68xk"
server_key: "2e845368e9085f7249401bf71c8f6529"
server_key_iv: "22ca4fc69728561d694ff5c3fbbbd997"
server_key_version: "encryptionkey@0"
I20260811 18:52:50.909097 26409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:50.921667 26409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:50.924120 26409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:50.924296 26409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:50.924886 26409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:50.924944 26409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:50.924981 26409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:50.925011 26409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:52:50 dist-test-slave-68xk krb5kdc[26216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474370, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:50.932914 26409 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:39675
I20260811 18:52:50.933068 26614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:39675 every 8 connection(s)
I20260811 18:52:50.933355 26409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:50.935626 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:50.925337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:37077 (local address 127.23.226.254:41399)
0811 18:52:50.925419 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:50.925422 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:50.925704 (+ 282us) server_negotiation.cc:407] Connection header received
0811 18:52:50.926570 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:50.926572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:50.926590 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:50.926659 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:50.927628 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.928153 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.929855 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.930088 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.930176 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:50.932745 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:50.932748 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:50.932748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:50.932759 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:50.934394 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:50.934828 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:50.934828 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:50.934829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:50.934886 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:50.935112 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:50.935113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:50.935113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:50.935218 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:50.935284 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:50.935491 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 18:52:50.935563 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 18:52:50.935887 26455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:50.925320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41399 (local address 127.23.226.193:37077)
0811 18:52:50.925529 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:50.925588 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:50.926385 (+ 797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:50.926776 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:50.926782 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:50.927200 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:50.927512 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:50.927521 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.928268 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.928269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:50.929750 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:50.929755 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.930199 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.930200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:50.930335 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:50.930955 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:50.930965 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:50.932629 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:50.934506 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:50.934512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:50.934514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:50.934755 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:50.934947 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:50.934947 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:50.934947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:50.935058 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:50.935260 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:50.935264 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:50.935384 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 18:52:50.935477 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:52:50.935606 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":108,"threads_started":1}
I20260811 18:52:50.936460 26617 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41399
I20260811 18:52:50.936545 26617 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:50.936720 26617 heartbeater.cc:511] Master 127.23.226.254:41399 requested a full tablet report, sending...
I20260811 18:52:50.937240 26286 ts_manager.cc:194] Registered new tserver with Master: 02b373569e464a0690c66b6d6ce3beae (127.23.226.193:39675)
I20260811 18:52:50.938040 26286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:37077
I20260811 18:52:50.943107 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26409
I20260811 18:52:50.943228 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:50.943427 24459 external_mini_cluster.cc:1428] Setting key 04ae7942c3227558636a31dd36a54f03
I20260811 18:52:50.943558 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:50.937673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:33485 (local address 127.23.226.254:41399)
0811 18:52:50.937724 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:50.937727 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:50.937860 (+ 133us) server_negotiation.cc:407] Connection header received
0811 18:52:50.937901 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:50.937902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:50.937912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:50.937973 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:50.938346 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.938913 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.939687 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.939907 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.939984 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:50.940980 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:50.940982 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:50.940982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:50.940990 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:50.942234 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:50.942683 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:50.942684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:50.942685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:50.942749 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:50.942983 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:50.942984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:50.942984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:50.943096 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:50.943179 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:50.943383 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 18:52:50.943474 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:52:50.943578 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:50.937611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41399 (local address 127.23.226.193:33485)
0811 18:52:50.937792 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:50.937802 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:50.937856 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:50.937977 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:50.937978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:50.938191 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:50.938264 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:50.938266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.939019 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.939020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:50.939584 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:50.939586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:50.939983 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:50.939984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:50.940069 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:50.940524 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:50.940530 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:50.940862 (+ 332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:50.942338 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:50.942339 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:50.942340 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:50.942589 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:50.942821 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:50.942822 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:50.942823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:50.942894 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:50.943176 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:50.943177 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:50.943241 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 18:52:50.943335 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 18:52:50.943443 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:52:50.969635 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41399
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:51.054890 26634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:51.055143 26634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:51.055189 26634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:51.056372 26634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:51.056433 26634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:51.056468 26634 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:52:51.056504 26634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:52:51.057924 26634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:41399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:51.058182 26634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:51.058434 26634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:51.063234 26643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:51.063269 26640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:51.063513 26641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:51.063817 26634 server_base.cc:1034] running on GCE node
I20260811 18:52:51.064078 26634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:51.064324 26634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:51.065526 26634 hybrid_clock.cc:648] HybridClock initialized: now 1786474371065505 us; error 42 us; skew 500 ppm
Aug 11 18:52:51 dist-test-slave-68xk krb5kdc[26216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:51.068286 26634 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:52:51.068780 26634 webserver.cc:460] Webserver started at http://127.23.226.194:36149/ using document root <none> and password file <none>
I20260811 18:52:51.069026 26634 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:51.069096 26634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:51.069263 26634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:51.070397 26634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "3f838a61b1314e72afafb7d011c44325"
format_stamp: "Formatted at 2026-08-11 18:52:51 on dist-test-slave-68xk"
server_key: "26b6e05258031041fe6248b65d32d9ce"
server_key_iv: "aaaf8ea15ba5f7deb3e696455bf97679"
server_key_version: "encryptionkey@0"
I20260811 18:52:51.070930 26634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "3f838a61b1314e72afafb7d011c44325"
format_stamp: "Formatted at 2026-08-11 18:52:51 on dist-test-slave-68xk"
server_key: "26b6e05258031041fe6248b65d32d9ce"
server_key_iv: "aaaf8ea15ba5f7deb3e696455bf97679"
server_key_version: "encryptionkey@0"
I20260811 18:52:51.072484 26634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:52:51.073323 26657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:51.073498 26634 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:52:51.073608 26634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "3f838a61b1314e72afafb7d011c44325"
format_stamp: "Formatted at 2026-08-11 18:52:51 on dist-test-slave-68xk"
server_key: "26b6e05258031041fe6248b65d32d9ce"
server_key_iv: "aaaf8ea15ba5f7deb3e696455bf97679"
server_key_version: "encryptionkey@0"
I20260811 18:52:51.073688 26634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:51.088984 26634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:51.091344 26634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:51.091535 26634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:51.092118 26634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:51.092199 26634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:51.092239 26634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:51.092284 26634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:52:51 dist-test-slave-68xk krb5kdc[26216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:51.100286 26634 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:35527
I20260811 18:52:51.100430 26837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:35527 every 8 connection(s)
I20260811 18:52:51.100773 26634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:51.103415 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.092626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:51831 (local address 127.23.226.254:41399)
0811 18:52:51.092718 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.092721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.092915 (+ 194us) server_negotiation.cc:407] Connection header received
0811 18:52:51.093485 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.093486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.093501 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.093551 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:51.094478 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.095445 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.096990 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.097200 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.097280 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.100339 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:51.100341 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:51.100341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:51.100349 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:51.101989 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.102427 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.102429 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.102429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.102488 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.102750 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.102752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.102752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.102885 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:51.102957 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.103232 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.103326 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:52:51.103595 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.092594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41399 (local address 127.23.226.194:51831)
0811 18:52:51.092801 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.092843 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.093364 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.093623 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.093628 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.093992 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:51.094319 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.094328 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.095562 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.095564 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.096907 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.096911 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.097313 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.097315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.097445 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.098084 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:51.098095 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:51.100184 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:51.102093 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.102101 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.102103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.102333 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.102560 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.102561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.102562 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.102677 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.102948 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:51.102956 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:51.103095 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.103196 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.103364 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":117,"threads_started":1}
I20260811 18:52:51.104139 26838 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41399
I20260811 18:52:51.104223 26838 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:51.104429 26838 heartbeater.cc:511] Master 127.23.226.254:41399 requested a full tablet report, sending...
I20260811 18:52:51.104876 26286 ts_manager.cc:194] Registered new tserver with Master: 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527)
I20260811 18:52:51.105114 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26634
I20260811 18:52:51.105232 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:51.105407 26286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:51831
I20260811 18:52:51.105468 24459 external_mini_cluster.cc:1428] Setting key 0c9cca7872293a6bd448629c7718f3e4
I20260811 18:52:51.111783 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.105370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41399 (local address 127.23.226.194:42711)
0811 18:52:51.105565 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.105577 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.105660 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.105850 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.105851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.106049 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:51.106146 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.106148 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.106831 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.106832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.107338 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.107339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.107702 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.107703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.107774 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.108310 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:51.108316 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:51.108709 (+ 393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:51.110696 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.110697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.110697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.110860 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.111111 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.111112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.111112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.111168 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.111544 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:51.111545 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:51.111582 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.111635 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.111709 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":83,"threads_started":1}
I20260811 18:52:51.111858 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.105315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:42711 (local address 127.23.226.254:41399)
0811 18:52:51.105360 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.105363 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.105630 (+ 267us) server_negotiation.cc:407] Connection header received
0811 18:52:51.105737 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.105738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.105748 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.105795 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:51.106206 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.106734 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.107418 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.107622 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.107688 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.108818 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:51.108819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:51.108819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:51.108826 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:51.110618 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.110942 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.110944 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.110944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.111019 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.111238 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.111239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.111240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.111469 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:51.111556 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.111669 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.111755 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:52:51.133250 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41399
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:51.222553 26849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:51.222772 26849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:51.222800 26849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:51.224076 26849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:51.224116 26849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:51.224136 26849 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:52:51.224161 26849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:52:51.225629 26849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:41399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:51.225872 26849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:51.226117 26849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:51.231364 26865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:51.231364 26858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:51.231407 26859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:51.231726 26849 server_base.cc:1034] running on GCE node
I20260811 18:52:51.231946 26849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:51.232189 26849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:51.233364 26849 hybrid_clock.cc:648] HybridClock initialized: now 1786474371233350 us; error 41 us; skew 500 ppm
Aug 11 18:52:51 dist-test-slave-68xk krb5kdc[26216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:51.235988 26849 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:52:51.236450 26849 webserver.cc:460] Webserver started at http://127.23.226.195:41867/ using document root <none> and password file <none>
I20260811 18:52:51.236640 26849 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:51.236681 26849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:51.236784 26849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:51.237908 26849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "3a0c9660fada4b00aa789a551fb1806e"
format_stamp: "Formatted at 2026-08-11 18:52:51 on dist-test-slave-68xk"
server_key: "9c24a254bafbf9f34117fa71cdb1bc32"
server_key_iv: "f575268780f18b4551154c0058eb4c99"
server_key_version: "encryptionkey@0"
I20260811 18:52:51.238227 26849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "3a0c9660fada4b00aa789a551fb1806e"
format_stamp: "Formatted at 2026-08-11 18:52:51 on dist-test-slave-68xk"
server_key: "9c24a254bafbf9f34117fa71cdb1bc32"
server_key_iv: "f575268780f18b4551154c0058eb4c99"
server_key_version: "encryptionkey@0"
I20260811 18:52:51.239562 26849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 18:52:51.240264 26878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:51.240440 26849 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:51.240526 26849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "3a0c9660fada4b00aa789a551fb1806e"
format_stamp: "Formatted at 2026-08-11 18:52:51 on dist-test-slave-68xk"
server_key: "9c24a254bafbf9f34117fa71cdb1bc32"
server_key_iv: "f575268780f18b4551154c0058eb4c99"
server_key_version: "encryptionkey@0"
I20260811 18:52:51.240581 26849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:51.256108 26849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:51.258365 26849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:51.258549 26849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:51.259045 26849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:51.259081 26849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:51.259107 26849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:51.259124 26849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:51.266597 26849 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:37259
I20260811 18:52:51.266677 27054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:37259 every 8 connection(s)
Aug 11 18:52:51 dist-test-slave-68xk krb5kdc[26216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:51.267014 26849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:51.268338 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26849
I20260811 18:52:51.268452 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:51.268620 24459 external_mini_cluster.cc:1428] Setting key b60e887e90d1d3d96b3dd05be79b9618
I20260811 18:52:51.270401 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.259764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:56561 (local address 127.23.226.254:41399)
0811 18:52:51.259818 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.259821 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.260072 (+ 251us) server_negotiation.cc:407] Connection header received
0811 18:52:51.260602 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.260604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.260618 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.260695 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:51.261503 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.262341 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.264005 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.264351 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.264429 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.267388 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:51.267390 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:51.267390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:51.267400 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:51.269007 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.269420 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.269422 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.269422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.269482 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.269744 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.269745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.269745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.269865 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:51.269938 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.270211 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.270306 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:52:51.270601 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.259676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41399 (local address 127.23.226.195:56561)
0811 18:52:51.259914 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.259963 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.260499 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.260789 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.260793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.261079 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:51.261372 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.261379 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.262490 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.262492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.263905 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.263909 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.264459 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.264460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.264613 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.265280 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:51.265304 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:51.267290 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:51.269093 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.269101 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.269104 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.269342 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.269559 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.269560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.269560 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.269672 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.269930 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:51.269938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:51.270076 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.270176 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.270344 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":103,"threads_started":1}
I20260811 18:52:51.271122 27055 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41399
I20260811 18:52:51.271212 27055 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:51.271411 27055 heartbeater.cc:511] Master 127.23.226.254:41399 requested a full tablet report, sending...
I20260811 18:52:51.271814 26284 ts_manager.cc:194] Registered new tserver with Master: 3a0c9660fada4b00aa789a551fb1806e (127.23.226.195:37259)
I20260811 18:52:51.272193 26284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:56561
I20260811 18:52:51.278110 27067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.272843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41399 (local address 127.23.226.195:58335)
0811 18:52:51.273002 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.273017 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.273065 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.273208 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.273209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.273386 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:51.273440 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.273441 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.274012 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.274012 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.274629 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.274631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.274948 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.274949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.275034 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.275447 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:51.275457 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:51.275750 (+ 293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:51.277127 (+ 1377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.277128 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.277128 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.277298 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.277482 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.277483 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.277483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.277534 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.277856 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:51.277857 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:51.277905 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.277964 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.278041 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260811 18:52:51.278208 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.272899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:58335 (local address 127.23.226.254:41399)
0811 18:52:51.272946 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.272948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.273073 (+ 125us) server_negotiation.cc:407] Connection header received
0811 18:52:51.273097 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.273098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.273106 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.273197 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:51.273497 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.273937 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.274702 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.274878 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.274934 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.275839 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:51.275840 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:51.275841 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:51.275847 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:51.277050 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.277359 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.277360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.277361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.277423 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.277619 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.277620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.277620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.277777 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:51.277861 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.278020 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.278085 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:52:51.280325 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:52:51 dist-test-slave-68xk krb5kdc[26216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:52:51 dist-test-slave-68xk krb5kdc[26216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:51.304793 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.297515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54804 (local address 127.23.226.254:41399)
0811 18:52:51.297583 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.297585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.297594 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:52:51.297665 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.297666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.297676 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.297719 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:51.298298 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.298848 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.299593 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.299785 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.299842 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.302253 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:51.302255 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:51.302255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:51.302262 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:51.303625 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.303999 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.304001 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.304001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.304070 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.304340 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.304340 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.304341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.304452 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:51.304536 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.304659 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.304727 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:52:51.306663 26284 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:51.308282 26284 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:51.315430 27094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.310970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51802 (local address 127.23.226.194:35527)
0811 18:52:51.311314 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.311319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.311330 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:52:51.311373 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.311375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.311393 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.311668 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:51.311738 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.312868 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.314464 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.315002 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.315115 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.315178 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.315290 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.315335 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":86,"threads_started":1}
I20260811 18:52:51.315409 27096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.310872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39675 (local address 127.0.0.1:59268)
0811 18:52:51.311274 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.311285 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.311387 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.311605 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.311606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.311608 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:51.311657 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.311658 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.313051 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.313052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.314087 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.314090 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.315017 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.315018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.315118 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.315135 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.315207 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.315291 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":70,"thread_start_us":94,"threads_started":1}
I20260811 18:52:51.315706 27097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.311352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55586 (local address 127.23.226.195:37259)
0811 18:52:51.311533 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.311537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.311712 (+ 175us) server_negotiation.cc:407] Connection header received
0811 18:52:51.311843 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.311846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.311861 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.311987 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:51.312092 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.312887 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.314398 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.315136 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.315212 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.315265 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.315598 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.315633 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260811 18:52:51.315419 27091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.310868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:35527 (local address 127.0.0.1:51802)
0811 18:52:51.311043 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.311089 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.311164 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.311503 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.311507 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.311510 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:51.311578 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.311579 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.312958 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.312959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.314302 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.314305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.315122 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.315124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.315206 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.315210 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.315274 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.315319 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":44,"thread_start_us":53,"threads_started":1}
I20260811 18:52:51.315547 27090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.311072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37259 (local address 127.0.0.1:55586)
0811 18:52:51.311537 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.311550 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.311745 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.311983 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.311984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.311986 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:51.312033 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.312035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.312993 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.312994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.314302 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.314305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.315334 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.315335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.315394 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.315398 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.315445 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.315488 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":83,"thread_start_us":108,"threads_started":1}
I20260811 18:52:51.316239 27095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.311022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59268 (local address 127.23.226.193:39675)
0811 18:52:51.311256 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.311261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.311355 (+ 94us) server_negotiation.cc:407] Connection header received
0811 18:52:51.311499 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.311502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.311520 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.311619 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:51.311754 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.312918 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.314179 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.314919 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.315004 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.315061 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.316039 (+ 978us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.316085 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":95,"threads_started":1}
I20260811 18:52:51.316612 26953 tablet_service.cc:1467] Processing CreateTablet for tablet b943fe42530b43318d5e94216e9b34e2 (DEFAULT_TABLE table=test-table [id=f28ca3dd51a64c98978c6de67e5d51b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:51.316646 26737 tablet_service.cc:1467] Processing CreateTablet for tablet b943fe42530b43318d5e94216e9b34e2 (DEFAULT_TABLE table=test-table [id=f28ca3dd51a64c98978c6de67e5d51b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:51.316974 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b943fe42530b43318d5e94216e9b34e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.316977 26953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b943fe42530b43318d5e94216e9b34e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.319787 27098 tablet_bootstrap.cc:492] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Bootstrap starting.
I20260811 18:52:51.320103 27099 tablet_bootstrap.cc:492] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Bootstrap starting.
I20260811 18:52:51.320740 27099 tablet_bootstrap.cc:654] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.320814 27098 tablet_bootstrap.cc:654] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.320814 26518 tablet_service.cc:1467] Processing CreateTablet for tablet b943fe42530b43318d5e94216e9b34e2 (DEFAULT_TABLE table=test-table [id=f28ca3dd51a64c98978c6de67e5d51b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:51.321120 27099 log.cc:824] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:51.321182 26518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b943fe42530b43318d5e94216e9b34e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.321189 27098 log.cc:824] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:51.321954 27099 tablet_bootstrap.cc:492] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: No bootstrap required, opened a new log
I20260811 18:52:51.322031 27099 ts_tablet_manager.cc:1397] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:51.322741 27098 tablet_bootstrap.cc:492] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: No bootstrap required, opened a new log
I20260811 18:52:51.322820 27098 ts_tablet_manager.cc:1397] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:52:51.324184 27098 raft_consensus.cc:348] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.324184 27099 raft_consensus.cc:348] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.324343 27098 raft_consensus.cc:374] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.324353 27099 raft_consensus.cc:374] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.324388 27099 raft_consensus.cc:729] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f838a61b1314e72afafb7d011c44325, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.324388 27098 raft_consensus.cc:729] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0c9660fada4b00aa789a551fb1806e, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.324496 27098 consensus_queue.cc:260] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.324504 27099 consensus_queue.cc:260] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.324748 27098 ts_tablet_manager.cc:1428] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:52:51.324765 27099 ts_tablet_manager.cc:1428] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 18:52:51.324918 27055 heartbeater.cc:503] Master 127.23.226.254:41399 was elected leader, sending a full tablet report...
I20260811 18:52:51.324944 26838 heartbeater.cc:503] Master 127.23.226.254:41399 was elected leader, sending a full tablet report...
I20260811 18:52:51.325090 27109 tablet_bootstrap.cc:492] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Bootstrap starting.
I20260811 18:52:51.325759 27109 tablet_bootstrap.cc:654] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.326139 27109 log.cc:824] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:51.327046 27109 tablet_bootstrap.cc:492] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: No bootstrap required, opened a new log
I20260811 18:52:51.327137 27109 ts_tablet_manager.cc:1397] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:51.328476 27109 raft_consensus.cc:348] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.328626 27109 raft_consensus.cc:374] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.328673 27109 raft_consensus.cc:729] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02b373569e464a0690c66b6d6ce3beae, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.328786 27109 consensus_queue.cc:260] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.329066 27109 ts_tablet_manager.cc:1428] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:52:51.329113 26617 heartbeater.cc:503] Master 127.23.226.254:41399 was elected leader, sending a full tablet report...
W20260811 18:52:51.351475 26839 tablet.cc:2369] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:52:51.434494 26618 tablet.cc:2369] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:51.489460 27111 raft_consensus.cc:482] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:51.489620 27111 raft_consensus.cc:504] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.490056 27111 leader_election.cc:288] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527), 3a0c9660fada4b00aa789a551fb1806e (127.23.226.195:37259)
I20260811 18:52:51.493475 27114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.490301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:35527 (local address 127.23.226.193:35357)
0811 18:52:51.490491 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.490503 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.490605 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.490774 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.490775 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.490777 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:51.490895 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.490898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.491774 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.491775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.492617 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.492619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.493195 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.493197 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.493271 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.493275 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.493345 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.493390 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":30,"thread_start_us":90,"threads_started":1}
I20260811 18:52:51.493463 27094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.490394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:35357 (local address 127.23.226.194:35527)
0811 18:52:51.490473 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.490475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.490584 (+ 109us) server_negotiation.cc:407] Connection header received
0811 18:52:51.490676 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.490678 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.490688 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.490737 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:51.490968 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.491681 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.492723 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.493108 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.493193 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.493202 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.493351 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.493390 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:52:51.493608 27115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.490548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37259 (local address 127.23.226.193:48453)
0811 18:52:51.490698 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.490708 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.490773 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.490915 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.490916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.490917 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:51.490976 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.490978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.491793 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.491794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.492618 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.492620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.493231 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.493233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.493386 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.493390 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.493485 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.493528 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":50,"thread_start_us":60,"threads_started":1}
I20260811 18:52:51.493636 27097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.490669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:48453 (local address 127.23.226.195:37259)
0811 18:52:51.490727 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.490729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.490757 (+ 28us) server_negotiation.cc:407] Connection header received
0811 18:52:51.490840 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.490841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.490849 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.490891 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:51.491051 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.491713 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.492718 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.493086 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.493225 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.493234 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.493507 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.493549 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:52:51.493824 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b943fe42530b43318d5e94216e9b34e2" candidate_uuid: "02b373569e464a0690c66b6d6ce3beae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f838a61b1314e72afafb7d011c44325" is_pre_election: true
I20260811 18:52:51.494000 26765 raft_consensus.cc:2454] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02b373569e464a0690c66b6d6ce3beae in term 0.
I20260811 18:52:51.494283 26442 leader_election.cc:302] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02b373569e464a0690c66b6d6ce3beae, 3f838a61b1314e72afafb7d011c44325; no voters:
I20260811 18:52:51.494447 26985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b943fe42530b43318d5e94216e9b34e2" candidate_uuid: "02b373569e464a0690c66b6d6ce3beae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0c9660fada4b00aa789a551fb1806e" is_pre_election: true
I20260811 18:52:51.494481 27111 raft_consensus.cc:2781] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:51.494544 27111 raft_consensus.cc:482] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:51.494561 27111 raft_consensus.cc:3037] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.494621 26985 raft_consensus.cc:2454] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02b373569e464a0690c66b6d6ce3beae in term 0.
I20260811 18:52:51.495425 27111 raft_consensus.cc:504] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.495555 27111 leader_election.cc:288] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [CANDIDATE]: Term 1 election: Requested vote from peers 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527), 3a0c9660fada4b00aa789a551fb1806e (127.23.226.195:37259)
I20260811 18:52:51.495745 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b943fe42530b43318d5e94216e9b34e2" candidate_uuid: "02b373569e464a0690c66b6d6ce3beae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f838a61b1314e72afafb7d011c44325"
I20260811 18:52:51.495781 26985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b943fe42530b43318d5e94216e9b34e2" candidate_uuid: "02b373569e464a0690c66b6d6ce3beae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0c9660fada4b00aa789a551fb1806e"
I20260811 18:52:51.495833 26765 raft_consensus.cc:3037] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.495860 26985 raft_consensus.cc:3037] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.496615 26985 raft_consensus.cc:2454] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02b373569e464a0690c66b6d6ce3beae in term 1.
I20260811 18:52:51.496812 26442 leader_election.cc:302] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02b373569e464a0690c66b6d6ce3beae, 3a0c9660fada4b00aa789a551fb1806e; no voters:
I20260811 18:52:51.496870 26765 raft_consensus.cc:2454] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02b373569e464a0690c66b6d6ce3beae in term 1.
I20260811 18:52:51.496901 27111 raft_consensus.cc:2781] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:51.497025 27111 raft_consensus.cc:686] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 1 LEADER]: Becoming Leader. State: Replica: 02b373569e464a0690c66b6d6ce3beae, State: Running, Role: LEADER
I20260811 18:52:51.497119 27111 consensus_queue.cc:237] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } }
I20260811 18:52:51.497946 26286 catalog_manager.cc:5495] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae reported cstate change: term changed from 0 to 1, leader changed from <none> to 02b373569e464a0690c66b6d6ce3beae (127.23.226.193). New cstate: current_term: 1 leader_uuid: "02b373569e464a0690c66b6d6ce3beae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } health_report { overall_health: HEALTHY } } }
W20260811 18:52:51.517700 27056 tablet.cc:2369] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:51.542711 27095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.539834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34036 (local address 127.23.226.193:39675)
0811 18:52:51.539896 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.539898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.539910 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:52:51.540019 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.540020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.540040 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.540117 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:51.540297 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.540827 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.541732 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.541950 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.542040 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.542287 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:51.542392 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:51.542525 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.542586 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.542611 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:52:51.544831 26985 raft_consensus.cc:1261] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Refusing update from remote peer 02b373569e464a0690c66b6d6ce3beae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:51.544831 26765 raft_consensus.cc:1261] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Refusing update from remote peer 02b373569e464a0690c66b6d6ce3beae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:51.545200 27116 consensus_queue.cc:1035] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:51.545359 27111 consensus_queue.cc:1035] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:51.548457 27122 mvcc.cc:205] Tried to move back new op lower bound from 7317399025844310016 to 7317399025652940800. Current Snapshot: MvccSnapshot[applied={T|T < 7317399025844310016}]
I20260811 18:52:51.548681 27121 mvcc.cc:205] Tried to move back new op lower bound from 7317399025844310016 to 7317399025652940800. Current Snapshot: MvccSnapshot[applied={T|T < 7317399025844310016}]
I20260811 18:52:51.551841 26286 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:51.552034 26286 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:51.553071 26286 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d: Sending DeleteTablet for 3 replicas of tablet b943fe42530b43318d5e94216e9b34e2
I20260811 18:52:51.553459 26953 tablet_service.cc:1514] Processing DeleteTablet for tablet b943fe42530b43318d5e94216e9b34e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:51 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:55586
I20260811 18:52:51.553471 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet b943fe42530b43318d5e94216e9b34e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:51 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:51802
I20260811 18:52:51.553517 26518 tablet_service.cc:1514] Processing DeleteTablet for tablet b943fe42530b43318d5e94216e9b34e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:51 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:59268
I20260811 18:52:51.554052 27138 tablet_replica.cc:330] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: stopping tablet replica
I20260811 18:52:51.554127 27134 tablet_replica.cc:330] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: stopping tablet replica
I20260811 18:52:51.554090 26286 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 18:52:51.554241 27134 raft_consensus.cc:2229] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 18:52:51.554311 26286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:51.554355 27134 raft_consensus.cc:2258] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:51.554581 27138 raft_consensus.cc:2229] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:51.554733 27138 raft_consensus.cc:2258] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:51.555239 27134 ts_tablet_manager.cc:1905] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:51.555739 26518 tablet_service.cc:1467] Processing CreateTablet for tablet ce439bec4c904c6c94b393a567163c54 (DEFAULT_TABLE table=test-table [id=50f8bd5d49cd4e9a9b032e18ccfddd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:51.555804 26737 tablet_service.cc:1467] Processing CreateTablet for tablet ce439bec4c904c6c94b393a567163c54 (DEFAULT_TABLE table=test-table [id=50f8bd5d49cd4e9a9b032e18ccfddd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:51.555866 26518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce439bec4c904c6c94b393a567163c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.555938 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce439bec4c904c6c94b393a567163c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.557036 27137 tablet_replica.cc:330] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: stopping tablet replica
I20260811 18:52:51.557129 27137 raft_consensus.cc:2229] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:51.557247 27137 raft_consensus.cc:2258] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:51.557386 27109 tablet_bootstrap.cc:492] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: Bootstrap starting.
I20260811 18:52:51.557408 27134 ts_tablet_manager.cc:1918] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:51.557468 27134 log.cc:1196] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/b943fe42530b43318d5e94216e9b34e2
I20260811 18:52:51.557495 27099 tablet_bootstrap.cc:492] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: Bootstrap starting.
I20260811 18:52:51.557775 27134 ts_tablet_manager.cc:1939] T b943fe42530b43318d5e94216e9b34e2 P 3a0c9660fada4b00aa789a551fb1806e: Deleting consensus metadata
I20260811 18:52:51.557852 27109 tablet_bootstrap.cc:654] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.557936 27099 tablet_bootstrap.cc:654] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.558634 26953 tablet_service.cc:1467] Processing CreateTablet for tablet ce439bec4c904c6c94b393a567163c54 (DEFAULT_TABLE table=test-table [id=50f8bd5d49cd4e9a9b032e18ccfddd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:51.558549 26266 catalog_manager.cc:4841] TS 3a0c9660fada4b00aa789a551fb1806e (127.23.226.195:37259): tablet b943fe42530b43318d5e94216e9b34e2 (table test-table [id=f28ca3dd51a64c98978c6de67e5d51b7]) successfully deleted
I20260811 18:52:51.558804 26953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce439bec4c904c6c94b393a567163c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.558867 27137 ts_tablet_manager.cc:1905] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:51.559000 27138 ts_tablet_manager.cc:1905] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:51.560214 27098 tablet_bootstrap.cc:492] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: Bootstrap starting.
I20260811 18:52:51.560243 27137 ts_tablet_manager.cc:1918] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:51.560300 27137 log.cc:1196] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/b943fe42530b43318d5e94216e9b34e2
I20260811 18:52:51.560550 27138 ts_tablet_manager.cc:1918] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:52:51.560572 27137 ts_tablet_manager.cc:1939] T b943fe42530b43318d5e94216e9b34e2 P 02b373569e464a0690c66b6d6ce3beae: Deleting consensus metadata
I20260811 18:52:51.560618 27138 log.cc:1196] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/b943fe42530b43318d5e94216e9b34e2
I20260811 18:52:51.560675 27098 tablet_bootstrap.cc:654] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.560891 27138 ts_tablet_manager.cc:1939] T b943fe42530b43318d5e94216e9b34e2 P 3f838a61b1314e72afafb7d011c44325: Deleting consensus metadata
I20260811 18:52:51.561008 26264 catalog_manager.cc:4841] TS 02b373569e464a0690c66b6d6ce3beae (127.23.226.193:39675): tablet b943fe42530b43318d5e94216e9b34e2 (table test-table [id=f28ca3dd51a64c98978c6de67e5d51b7]) successfully deleted
I20260811 18:52:51.561261 26266 catalog_manager.cc:4841] TS 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527): tablet b943fe42530b43318d5e94216e9b34e2 (table test-table [id=f28ca3dd51a64c98978c6de67e5d51b7]) successfully deleted
I20260811 18:52:51.561439 27098 tablet_bootstrap.cc:492] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: No bootstrap required, opened a new log
I20260811 18:52:51.561494 27098 ts_tablet_manager.cc:1397] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:51.561700 27099 tablet_bootstrap.cc:492] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: No bootstrap required, opened a new log
I20260811 18:52:51.561673 27098 raft_consensus.cc:348] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.561741 27098 raft_consensus.cc:374] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.561738 27099 ts_tablet_manager.cc:1397] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 18:52:51.561765 27098 raft_consensus.cc:729] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0c9660fada4b00aa789a551fb1806e, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.561816 27098 consensus_queue.cc:260] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.561859 27109 tablet_bootstrap.cc:492] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: No bootstrap required, opened a new log
I20260811 18:52:51.561914 27098 ts_tablet_manager.cc:1428] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:51.561918 27109 ts_tablet_manager.cc:1397] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 18:52:51.561896 27099 raft_consensus.cc:348] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.561964 27099 raft_consensus.cc:374] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.561990 27099 raft_consensus.cc:729] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f838a61b1314e72afafb7d011c44325, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.562038 27099 consensus_queue.cc:260] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.562067 27109 raft_consensus.cc:348] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.562125 27099 ts_tablet_manager.cc:1428] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 18:52:51.562143 27109 raft_consensus.cc:374] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.562168 27109 raft_consensus.cc:729] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02b373569e464a0690c66b6d6ce3beae, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.562211 27109 consensus_queue.cc:260] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.562299 27109 ts_tablet_manager.cc:1428] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:51.676858 27127 raft_consensus.cc:482] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:51.676975 27127 raft_consensus.cc:504] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.677137 27127 leader_election.cc:288] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527), 3a0c9660fada4b00aa789a551fb1806e (127.23.226.195:37259)
I20260811 18:52:51.677438 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce439bec4c904c6c94b393a567163c54" candidate_uuid: "02b373569e464a0690c66b6d6ce3beae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f838a61b1314e72afafb7d011c44325" is_pre_election: true
I20260811 18:52:51.677438 26985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce439bec4c904c6c94b393a567163c54" candidate_uuid: "02b373569e464a0690c66b6d6ce3beae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0c9660fada4b00aa789a551fb1806e" is_pre_election: true
I20260811 18:52:51.677557 26985 raft_consensus.cc:2454] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02b373569e464a0690c66b6d6ce3beae in term 0.
I20260811 18:52:51.677557 26765 raft_consensus.cc:2454] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02b373569e464a0690c66b6d6ce3beae in term 0.
I20260811 18:52:51.677779 26442 leader_election.cc:302] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02b373569e464a0690c66b6d6ce3beae, 3a0c9660fada4b00aa789a551fb1806e; no voters:
I20260811 18:52:51.677904 27127 raft_consensus.cc:2781] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:51.677958 27127 raft_consensus.cc:482] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:51.677991 27127 raft_consensus.cc:3037] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.678843 27127 raft_consensus.cc:504] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.678992 27127 leader_election.cc:288] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [CANDIDATE]: Term 1 election: Requested vote from peers 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527), 3a0c9660fada4b00aa789a551fb1806e (127.23.226.195:37259)
I20260811 18:52:51.679234 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce439bec4c904c6c94b393a567163c54" candidate_uuid: "02b373569e464a0690c66b6d6ce3beae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f838a61b1314e72afafb7d011c44325"
I20260811 18:52:51.679332 26765 raft_consensus.cc:3037] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.679291 26985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce439bec4c904c6c94b393a567163c54" candidate_uuid: "02b373569e464a0690c66b6d6ce3beae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0c9660fada4b00aa789a551fb1806e"
I20260811 18:52:51.679385 26985 raft_consensus.cc:3037] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.680056 26765 raft_consensus.cc:2454] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02b373569e464a0690c66b6d6ce3beae in term 1.
I20260811 18:52:51.680089 26985 raft_consensus.cc:2454] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02b373569e464a0690c66b6d6ce3beae in term 1.
I20260811 18:52:51.680284 26442 leader_election.cc:302] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02b373569e464a0690c66b6d6ce3beae, 3a0c9660fada4b00aa789a551fb1806e; no voters:
I20260811 18:52:51.680398 27127 raft_consensus.cc:2781] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:51.680460 27127 raft_consensus.cc:686] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 1 LEADER]: Becoming Leader. State: Replica: 02b373569e464a0690c66b6d6ce3beae, State: Running, Role: LEADER
I20260811 18:52:51.680522 27127 consensus_queue.cc:237] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.681209 26286 catalog_manager.cc:5495] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae reported cstate change: term changed from 0 to 1, leader changed from <none> to 02b373569e464a0690c66b6d6ce3beae (127.23.226.193). New cstate: current_term: 1 leader_uuid: "02b373569e464a0690c66b6d6ce3beae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
Aug 11 18:52:51 dist-test-slave-68xk krb5kdc[26216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474370, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:51.742997 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.735347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46478 (local address 127.23.226.254:41399)
0811 18:52:51.735568 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.735570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.735620 (+ 50us) server_negotiation.cc:407] Connection header received
0811 18:52:51.735723 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.735724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.735740 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.735818 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:51.736379 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.736878 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.737707 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.737901 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.737973 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.740330 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:51.740332 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:51.740332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:51.740339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:51.741736 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.742154 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.742155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.742156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.742211 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.742432 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.742433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.742434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.742548 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:51.742625 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.742787 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.742896 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193}
I20260811 18:52:51.743114 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.735243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41399 (local address 127.0.0.1:46478)
0811 18:52:51.735529 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.735544 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.735635 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.735822 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.735823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.736213 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:51.736291 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.736294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.736997 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.736999 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.737621 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.737623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.737972 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.737973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.738027 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.738775 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:51.738781 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:51.740218 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:51.741836 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.741845 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.741847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.742047 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.742276 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:51.742276 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:51.742277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:51.742337 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:51.742630 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:51.742637 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:51.742684 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.742764 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.742980 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":90,"thread_start_us":132,"threads_started":1}
I20260811 18:52:51.745018 26286 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:46478:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:52:51.745226 26286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:51.746874 26518 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd1485c52104947878d7d163b981e79 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=105d1b06be084469850ebb9c3d49b78d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:52:51.746910 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd1485c52104947878d7d163b981e79 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=105d1b06be084469850ebb9c3d49b78d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:52:51.747067 26518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd1485c52104947878d7d163b981e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.747097 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd1485c52104947878d7d163b981e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.748579 27109 tablet_bootstrap.cc:492] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: Bootstrap starting.
I20260811 18:52:51.748649 27099 tablet_bootstrap.cc:492] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: Bootstrap starting.
I20260811 18:52:51.748709 26953 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd1485c52104947878d7d163b981e79 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=105d1b06be084469850ebb9c3d49b78d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:52:51.748857 26953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd1485c52104947878d7d163b981e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:51.748940 27109 tablet_bootstrap.cc:654] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.749048 27099 tablet_bootstrap.cc:654] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.749632 27109 tablet_bootstrap.cc:492] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: No bootstrap required, opened a new log
I20260811 18:52:51.749696 27109 ts_tablet_manager.cc:1397] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:51.749863 27109 raft_consensus.cc:348] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.749950 27109 raft_consensus.cc:374] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.749969 27109 raft_consensus.cc:729] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02b373569e464a0690c66b6d6ce3beae, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.750015 27109 consensus_queue.cc:260] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.750129 27109 ts_tablet_manager.cc:1428] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:51.750249 27127 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.750331 27127 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:51.750531 27098 tablet_bootstrap.cc:492] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: Bootstrap starting.
I20260811 18:52:51.750994 27098 tablet_bootstrap.cc:654] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:51.751025 27099 tablet_bootstrap.cc:492] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: No bootstrap required, opened a new log
I20260811 18:52:51.751070 27099 ts_tablet_manager.cc:1397] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:52:51.751307 27099 raft_consensus.cc:348] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.751391 27099 raft_consensus.cc:374] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.751412 27099 raft_consensus.cc:729] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f838a61b1314e72afafb7d011c44325, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.751458 27099 consensus_queue.cc:260] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.751577 27099 ts_tablet_manager.cc:1428] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:51.751699 27098 tablet_bootstrap.cc:492] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: No bootstrap required, opened a new log
I20260811 18:52:51.751672 27107 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.751741 27098 ts_tablet_manager.cc:1397] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:51.751756 27107 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:51.751881 27098 raft_consensus.cc:348] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.751933 27098 raft_consensus.cc:374] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:51.751947 27098 raft_consensus.cc:729] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0c9660fada4b00aa789a551fb1806e, State: Initialized, Role: FOLLOWER
I20260811 18:52:51.752003 27098 consensus_queue.cc:260] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.752095 27098 ts_tablet_manager.cc:1428] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:51.752205 27106 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.752306 27106 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:51.812338 27106 raft_consensus.cc:482] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:51.812479 27106 raft_consensus.cc:504] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.812847 27106 leader_election.cc:288] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02b373569e464a0690c66b6d6ce3beae (127.23.226.193:39675), 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527)
I20260811 18:52:51.815956 27094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.813112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:55733 (local address 127.23.226.194:35527)
0811 18:52:51.813164 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.813166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.813266 (+ 100us) server_negotiation.cc:407] Connection header received
0811 18:52:51.813342 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.813343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.813354 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.813424 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:51.813606 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.814121 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.815199 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.815611 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.815694 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.815703 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.815849 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.815888 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:52:51.816021 27165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.813026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:35527 (local address 127.23.226.195:55733)
0811 18:52:51.813181 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.813193 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.813280 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.813429 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.813430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.813432 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:51.813491 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.813493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.814211 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.814212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.815104 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.815107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.815694 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.815695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.815773 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.815777 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.815841 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.815883 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260811 18:52:51.816172 27095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.813175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:32985 (local address 127.23.226.193:39675)
0811 18:52:51.813228 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.813230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.813279 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:52:51.813380 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.813382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.813400 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.813470 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:51.813652 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.814175 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.815242 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.815725 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.815811 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.815819 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.816039 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.816089 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:52:51.816447 27167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.813045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39675 (local address 127.23.226.195:32985)
0811 18:52:51.813207 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.813221 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.813294 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.813475 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.813476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.813479 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:51.813575 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.813576 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.814266 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.814268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.815143 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.815145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.815812 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.815813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.815935 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.815939 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.816300 (+ 361us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.816358 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20260811 18:52:51.816537 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dd1485c52104947878d7d163b981e79" candidate_uuid: "3a0c9660fada4b00aa789a551fb1806e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f838a61b1314e72afafb7d011c44325" is_pre_election: true
I20260811 18:52:51.816653 26765 raft_consensus.cc:2454] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a0c9660fada4b00aa789a551fb1806e in term 0.
I20260811 18:52:51.816756 26545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dd1485c52104947878d7d163b981e79" candidate_uuid: "3a0c9660fada4b00aa789a551fb1806e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02b373569e464a0690c66b6d6ce3beae" is_pre_election: true
I20260811 18:52:51.816872 26881 leader_election.cc:302] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a0c9660fada4b00aa789a551fb1806e, 3f838a61b1314e72afafb7d011c44325; no voters:
I20260811 18:52:51.816908 26545 raft_consensus.cc:2454] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a0c9660fada4b00aa789a551fb1806e in term 0.
I20260811 18:52:51.817107 27106 raft_consensus.cc:2781] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:51.817167 27106 raft_consensus.cc:482] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:51.817191 27106 raft_consensus.cc:3037] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.817939 27106 raft_consensus.cc:504] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.818092 27106 leader_election.cc:288] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [CANDIDATE]: Term 1 election: Requested vote from peers 02b373569e464a0690c66b6d6ce3beae (127.23.226.193:39675), 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527)
I20260811 18:52:51.818275 26545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dd1485c52104947878d7d163b981e79" candidate_uuid: "3a0c9660fada4b00aa789a551fb1806e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02b373569e464a0690c66b6d6ce3beae"
I20260811 18:52:51.818270 26765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dd1485c52104947878d7d163b981e79" candidate_uuid: "3a0c9660fada4b00aa789a551fb1806e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f838a61b1314e72afafb7d011c44325"
I20260811 18:52:51.818356 26545 raft_consensus.cc:3037] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.818356 26765 raft_consensus.cc:3037] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:51.819190 26765 raft_consensus.cc:2454] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a0c9660fada4b00aa789a551fb1806e in term 1.
I20260811 18:52:51.819300 26545 raft_consensus.cc:2454] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a0c9660fada4b00aa789a551fb1806e in term 1.
I20260811 18:52:51.819401 26881 leader_election.cc:302] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a0c9660fada4b00aa789a551fb1806e, 3f838a61b1314e72afafb7d011c44325; no voters:
I20260811 18:52:51.819512 27106 raft_consensus.cc:2781] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:51.819630 27106 raft_consensus.cc:686] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [term 1 LEADER]: Becoming Leader. State: Replica: 3a0c9660fada4b00aa789a551fb1806e, State: Running, Role: LEADER
I20260811 18:52:51.819700 27106 consensus_queue.cc:237] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } }
I20260811 18:52:51.820048 27168 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: TxnStatusTablet state changed. Reason: New leader 3a0c9660fada4b00aa789a551fb1806e. Latest consensus state: current_term: 1 leader_uuid: "3a0c9660fada4b00aa789a551fb1806e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.820166 27168 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:52:51.820421 27170 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:52:51.820415 26284 catalog_manager.cc:5495] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a0c9660fada4b00aa789a551fb1806e (127.23.226.195). New cstate: current_term: 1 leader_uuid: "3a0c9660fada4b00aa789a551fb1806e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260811 18:52:51.820533 27170 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:52:51.844435 27097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.841798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58238 (local address 127.23.226.195:37259)
0811 18:52:51.841848 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.841850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.841874 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:52:51.841990 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.841991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.842011 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.842088 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:51.842212 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.842798 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.843602 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.843822 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.843897 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.844098 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:51.844203 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:51.844281 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.844337 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.844357 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:52:51.844446 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.841736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37259 (local address 127.0.0.1:58238)
0811 18:52:51.841824 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.841838 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.841893 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.842095 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.842096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.842097 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:51.842151 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.842153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.842887 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.842888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.843516 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.843518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.843897 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.843898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.843967 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.843987 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:51.844267 (+ 280us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:51.844278 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.844324 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.844375 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:52:51.845712 26765 raft_consensus.cc:1261] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Refusing update from remote peer 3a0c9660fada4b00aa789a551fb1806e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:51.845713 26545 raft_consensus.cc:1261] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae [term 1 FOLLOWER]: Refusing update from remote peer 3a0c9660fada4b00aa789a551fb1806e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:51.846002 27168 consensus_queue.cc:1035] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:51.846117 27106 consensus_queue.cc:1035] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e [LEADER]: Connected to new peer: Peer: permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:51.846674 27107 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: TxnStatusTablet state changed. Reason: New leader 3a0c9660fada4b00aa789a551fb1806e. Latest consensus state: current_term: 1 leader_uuid: "3a0c9660fada4b00aa789a551fb1806e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.846784 27107 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:51.846830 27127 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: TxnStatusTablet state changed. Reason: New leader 3a0c9660fada4b00aa789a551fb1806e. Latest consensus state: current_term: 1 leader_uuid: "3a0c9660fada4b00aa789a551fb1806e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.846928 27127 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:51.847659 27106 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a0c9660fada4b00aa789a551fb1806e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.847769 27106 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:52:51.848207 27127 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a0c9660fada4b00aa789a551fb1806e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.848299 27127 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 02b373569e464a0690c66b6d6ce3beae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:51.848737 27106 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a0c9660fada4b00aa789a551fb1806e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.848829 27106 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 3a0c9660fada4b00aa789a551fb1806e: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:52:51.849853 27107 tablet_replica.cc:439] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a0c9660fada4b00aa789a551fb1806e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b373569e464a0690c66b6d6ce3beae" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39675 } } peers { permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 } } peers { permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 } } }
I20260811 18:52:51.849941 27107 tablet_replica.cc:442] T 2dd1485c52104947878d7d163b981e79 P 3f838a61b1314e72afafb7d011c44325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:51.854185 27097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.851876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:39653 (local address 127.23.226.195:37259)
0811 18:52:51.851920 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.851922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.852042 (+ 120us) server_negotiation.cc:407] Connection header received
0811 18:52:51.852110 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.852111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.852121 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.852167 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:51.852306 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.852745 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.853501 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.853710 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.853780 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.853954 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:51.853987 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:51.854045 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.854106 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.854124 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:52:51.854257 27182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.851803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37259 (local address 127.23.226.193:39653)
0811 18:52:51.851954 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.851965 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.852059 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.852187 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.852187 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.852189 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:51.852235 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.852237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.852831 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.852832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.853417 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.853419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.853792 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.853793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.853854 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.853875 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:51.854059 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:51.854061 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.854104 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.854162 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":76,"threads_started":1}
I20260811 18:52:51.856377 26985 raft_consensus.cc:1261] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Refusing update from remote peer 02b373569e464a0690c66b6d6ce3beae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:51.856405 26765 raft_consensus.cc:1261] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Refusing update from remote peer 02b373569e464a0690c66b6d6ce3beae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:51.856600 27111 consensus_queue.cc:1035] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f838a61b1314e72afafb7d011c44325" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:51.856678 27127 consensus_queue.cc:1035] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a0c9660fada4b00aa789a551fb1806e" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:51.857815 27120 mvcc.cc:205] Tried to move back new op lower bound from 7317399027122274304 to 7317399026403917824. Current Snapshot: MvccSnapshot[applied={T|T < 7317399027122274304}]
I20260811 18:52:51.865684 27095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.861984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:48479 (local address 127.23.226.193:39675)
0811 18:52:51.862025 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.862026 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.862094 (+ 68us) server_negotiation.cc:407] Connection header received
0811 18:52:51.862141 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.862142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.862151 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.862220 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:51.862304 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.863091 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.865054 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.865242 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.865297 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.865492 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:51.865519 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:51.865554 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.865612 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.865631 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:52:51.866132 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.861877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39675 (local address 127.23.226.195:48479)
0811 18:52:51.862031 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:51.862042 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:51.862102 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:51.862221 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:51.862222 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:51.862223 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:51.862267 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.862268 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.864018 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.864020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.864956 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:51.864960 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.865314 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.865315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:51.865385 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.865402 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:51.865557 (+ 155us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:51.865559 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:52:51.865608 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 18:52:51.865654 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260811 18:52:51.873549 26284 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:51.873646 26284 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:51.874200 26284 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef1313550f3341b089cfdb0bea9ef59d: Sending DeleteTablet for 3 replicas of tablet ce439bec4c904c6c94b393a567163c54
I20260811 18:52:51.874461 26518 tablet_service.cc:1514] Processing DeleteTablet for tablet ce439bec4c904c6c94b393a567163c54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:51 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:59268
I20260811 18:52:51.874570 26737 tablet_service.cc:1514] Processing DeleteTablet for tablet ce439bec4c904c6c94b393a567163c54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:51 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:51802
I20260811 18:52:51.874684 27137 tablet_replica.cc:330] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: stopping tablet replica
I20260811 18:52:51.874673 27138 tablet_replica.cc:330] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: stopping tablet replica
I20260811 18:52:51.874747 27138 raft_consensus.cc:2229] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:51.874751 27137 raft_consensus.cc:2229] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:51.874797 27138 raft_consensus.cc:2258] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:51.874816 27137 raft_consensus.cc:2258] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:51.874919 26953 tablet_service.cc:1514] Processing DeleteTablet for tablet ce439bec4c904c6c94b393a567163c54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:51 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:55586
I20260811 18:52:51.875002 27134 tablet_replica.cc:330] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: stopping tablet replica
I20260811 18:52:51.875048 27134 raft_consensus.cc:2229] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:51.875087 27134 raft_consensus.cc:2258] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:51.875159 27137 ts_tablet_manager.cc:1905] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:51.875193 27138 ts_tablet_manager.cc:1905] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:51.875471 27134 ts_tablet_manager.cc:1905] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:51.876878 27138 ts_tablet_manager.cc:1918] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:51.876941 27138 log.cc:1196] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/ce439bec4c904c6c94b393a567163c54
I20260811 18:52:51.877043 27137 ts_tablet_manager.cc:1918] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:51.877094 27137 log.cc:1196] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/ce439bec4c904c6c94b393a567163c54
I20260811 18:52:51.877187 27138 ts_tablet_manager.cc:1939] T ce439bec4c904c6c94b393a567163c54 P 3f838a61b1314e72afafb7d011c44325: Deleting consensus metadata
I20260811 18:52:51.877192 27134 ts_tablet_manager.cc:1918] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:51.877249 27134 log.cc:1196] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/ce439bec4c904c6c94b393a567163c54
I20260811 18:52:51.877302 27137 ts_tablet_manager.cc:1939] T ce439bec4c904c6c94b393a567163c54 P 02b373569e464a0690c66b6d6ce3beae: Deleting consensus metadata
I20260811 18:52:51.877493 27134 ts_tablet_manager.cc:1939] T ce439bec4c904c6c94b393a567163c54 P 3a0c9660fada4b00aa789a551fb1806e: Deleting consensus metadata
I20260811 18:52:51.877617 26266 catalog_manager.cc:4841] TS 3f838a61b1314e72afafb7d011c44325 (127.23.226.194:35527): tablet ce439bec4c904c6c94b393a567163c54 (table test-table [id=50f8bd5d49cd4e9a9b032e18ccfddd7c]) successfully deleted
I20260811 18:52:51.877630 26264 catalog_manager.cc:4841] TS 02b373569e464a0690c66b6d6ce3beae (127.23.226.193:39675): tablet ce439bec4c904c6c94b393a567163c54 (table test-table [id=50f8bd5d49cd4e9a9b032e18ccfddd7c]) successfully deleted
I20260811 18:52:51.878053 26266 catalog_manager.cc:4841] TS 3a0c9660fada4b00aa789a551fb1806e (127.23.226.195:37259): tablet ce439bec4c904c6c94b393a567163c54 (table test-table [id=50f8bd5d49cd4e9a9b032e18ccfddd7c]) successfully deleted
Aug 11 18:52:51 dist-test-slave-68xk krb5kdc[26216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474371, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:52:51.884689 27095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.875212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34046 (local address 127.23.226.193:39675)
0811 18:52:51.875258 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.875260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.875527 (+ 267us) server_negotiation.cc:407] Connection header received
0811 18:52:51.875627 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.875628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.875642 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.875674 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:51.876543 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.877224 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.878340 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.878609 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.878698 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.881697 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:51.881709 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:51.881710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:51.881718 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:51.883467 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.883853 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.883856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.883857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.883923 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.884125 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.884126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.884126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.884280 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:51.884454 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.884492 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.884579 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 18:52:51.884931 26608 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34046
I20260811 18:52:51.892437 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:51.885958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.23.226.254:41399)
0811 18:52:51.886006 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:51.886008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:51.886045 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:52:51.886108 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:51.886109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:51.886119 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:51.886184 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:51.886752 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.887489 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.888173 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:51.888457 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:51.888531 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:51.889706 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:51.889708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:51.889708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:51.889724 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:51.891340 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.891681 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.891682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.891682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.891754 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:51.891951 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:51.891952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:51.891953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:51.892085 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:51.892188 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:51.892265 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:52:51.892346 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 18:52:51.892753 26284 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46494
I20260811 18:52:51.893492 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26409
I20260811 18:52:51.905994 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26634
I20260811 18:52:51.924983 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26849
I20260811 18:52:51.939101 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26242
2026-08-11T18:52:51Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2699 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:52 dist-test-slave-68xk krb5kdc[27204](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:52 dist-test-slave-68xk krb5kdc[27204](info): set up 2 sockets
Aug 11 18:52:52 dist-test-slave-68xk krb5kdc[27204](info): commencing operation
krb5kdc: starting...
W20260811 18:52:53.188495 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:52:53 dist-test-slave-68xk krb5kdc[27204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:52:53.312847 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:45607
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:45607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:53.396435 27227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:53.396675 27227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:53.396714 27227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:53.397851 27227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:53.397914 27227 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:52:53.397938 27227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:53.397959 27227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:53.397989 27227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:53.398012 27227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:53.399559 27227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:45607
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:45607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:53.399832 27227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:53.400061 27227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:53.404970 27235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:53.404935 27237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:53.404947 27233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:53.405838 27227 server_base.cc:1034] running on GCE node
I20260811 18:52:53.406102 27227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:53.406401 27227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:53.407620 27227 hybrid_clock.cc:648] HybridClock initialized: now 1786474373407599 us; error 38 us; skew 500 ppm
Aug 11 18:52:53 dist-test-slave-68xk krb5kdc[27204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:53.417930 27227 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:52:53.418500 27227 webserver.cc:460] Webserver started at http://127.23.226.254:36267/ using document root <none> and password file <none>
I20260811 18:52:53.418753 27227 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:53.418802 27227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:53.418915 27227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:53.420064 27227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "a6b21284ba0741008f8c38dd01e2c2df"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "2987a3a1042f180723f00386163d8321"
server_key_iv: "a01d1ddc6d7eb9ccc52eac7fc2ac0173"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.420401 27227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "a6b21284ba0741008f8c38dd01e2c2df"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "2987a3a1042f180723f00386163d8321"
server_key_iv: "a01d1ddc6d7eb9ccc52eac7fc2ac0173"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.421834 27227 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:52:53.422641 27247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:53.422850 27227 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:52:53.422979 27227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "a6b21284ba0741008f8c38dd01e2c2df"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "2987a3a1042f180723f00386163d8321"
server_key_iv: "a01d1ddc6d7eb9ccc52eac7fc2ac0173"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.423069 27227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:53.452103 27227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:53.454768 27227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:53.454968 27227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:53.460186 27227 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:45607
I20260811 18:52:53.460243 27358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:45607 every 8 connection(s)
I20260811 18:52:53.460597 27227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:53.461285 27359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:53.463686 27359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: Bootstrap starting.
I20260811 18:52:53.464318 27359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:53.464605 27359 log.cc:824] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:53.465368 27359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: No bootstrap required, opened a new log
I20260811 18:52:53.467617 27359 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b21284ba0741008f8c38dd01e2c2df" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 45607 } }
I20260811 18:52:53.467787 27359 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:53.467829 27359 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6b21284ba0741008f8c38dd01e2c2df, State: Initialized, Role: FOLLOWER
I20260811 18:52:53.468006 27359 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b21284ba0741008f8c38dd01e2c2df" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 45607 } }
I20260811 18:52:53.468106 27359 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:53.468146 27359 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:53.468199 27359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:53.468454 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 27227
I20260811 18:52:53.468531 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:52:53.468705 24459 external_mini_cluster.cc:1428] Setting key 03ad898b2e05322d09da29ac3c17a90b
I20260811 18:52:53.468828 27359 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b21284ba0741008f8c38dd01e2c2df" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 45607 } }
I20260811 18:52:53.468961 27359 leader_election.cc:302] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6b21284ba0741008f8c38dd01e2c2df; no voters:
I20260811 18:52:53.469137 27359 leader_election.cc:288] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:53.469237 27363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:53.469426 27359 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:53.469470 27363 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [term 1 LEADER]: Becoming Leader. State: Replica: a6b21284ba0741008f8c38dd01e2c2df, State: Running, Role: LEADER
I20260811 18:52:53.469662 27363 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b21284ba0741008f8c38dd01e2c2df" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 45607 } }
I20260811 18:52:53.470059 27365 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6b21284ba0741008f8c38dd01e2c2df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b21284ba0741008f8c38dd01e2c2df" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 45607 } } }
I20260811 18:52:53.470150 27365 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:53.470304 27365 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6b21284ba0741008f8c38dd01e2c2df. Latest consensus state: current_term: 1 leader_uuid: "a6b21284ba0741008f8c38dd01e2c2df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b21284ba0741008f8c38dd01e2c2df" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 45607 } } }
I20260811 18:52:53.470364 27365 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:53.470871 27380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:53.471504 27380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:53.474058 27380 catalog_manager.cc:1347] Generated new cluster ID: fc5dc1060fd04c5fabd3134938064cae
I20260811 18:52:53.474115 27380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:52:53 dist-test-slave-68xk krb5kdc[27204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:53.480578 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.469258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57786 (local address 127.23.226.254:45607)
0811 18:52:53.469481 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:53.469492 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:53.469554 (+ 62us) server_negotiation.cc:407] Connection header received
0811 18:52:53.469674 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:53.469681 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:53.469739 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:53.469921 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:53.470940 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.472406 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.473338 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.473799 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.473929 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.476797 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:53.476802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:53.476802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:53.476814 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:53.478836 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.479276 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.479279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.479280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.479411 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.479634 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.479635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.479635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.479936 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:53.480079 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:53.480223 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 18:52:53.480359 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":90,"threads_started":1}
I20260811 18:52:53.486168 27380 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:53.486747 27380 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:53.489498 27380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: Generated new TSK 0
I20260811 18:52:53.489667 27380 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:52:53.524844 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:45607
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:53.634310 27400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:53.634598 27400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:53.634629 27400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:53.635802 27400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:53.635845 27400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:53.635866 27400 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:52:53.635878 27400 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:52:53.635895 27400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:52:53.637378 27400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:45607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:53.637631 27400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:53.637866 27400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:53.642932 27411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:53.642920 27409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:53.643061 27407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:53.643293 27400 server_base.cc:1034] running on GCE node
I20260811 18:52:53.643450 27400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:53.643651 27400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:53.644807 27400 hybrid_clock.cc:648] HybridClock initialized: now 1786474373644785 us; error 36 us; skew 500 ppm
Aug 11 18:52:53 dist-test-slave-68xk krb5kdc[27204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:53.651381 27400 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:52:53.651867 27400 webserver.cc:460] Webserver started at http://127.23.226.193:45853/ using document root <none> and password file <none>
I20260811 18:52:53.652115 27400 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:53.652161 27400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:53.652323 27400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:53.653409 27400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "2c4aa55456434e03b1f35b0ee6e3bc36"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "eed0d1a29795cd0c7b6cbb4bc0c57e75"
server_key_iv: "3f9a16060f1980f7e8c1d06a702dd065"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.653777 27400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "2c4aa55456434e03b1f35b0ee6e3bc36"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "eed0d1a29795cd0c7b6cbb4bc0c57e75"
server_key_iv: "3f9a16060f1980f7e8c1d06a702dd065"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.655181 27400 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:52:53.655894 27427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:53.656066 27400 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:53.656155 27400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "2c4aa55456434e03b1f35b0ee6e3bc36"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "eed0d1a29795cd0c7b6cbb4bc0c57e75"
server_key_iv: "3f9a16060f1980f7e8c1d06a702dd065"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.656235 27400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:53.685845 27400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:53.687891 27400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:53.688062 27400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:53.688699 27400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:53.688773 27400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:53.688813 27400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:53.688834 27400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:52:53 dist-test-slave-68xk krb5kdc[27204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:53.696710 27400 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:32921
I20260811 18:52:53.696817 27630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:32921 every 8 connection(s)
I20260811 18:52:53.697173 27400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:53.699402 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.689177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:34835 (local address 127.23.226.254:45607)
0811 18:52:53.689259 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:53.689261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:53.689503 (+ 242us) server_negotiation.cc:407] Connection header received
0811 18:52:53.690219 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:53.690221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:53.690236 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:53.690327 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:53.691256 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.692105 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.693796 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.694068 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.694165 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.696370 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:53.696372 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:53.696373 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:53.696381 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:53.698190 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.698604 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.698605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.698605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.698660 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.698865 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.698865 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.698866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.698961 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:53.699006 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:53.699266 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 18:52:53.699337 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:52:53.699506 27447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.689165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:45607 (local address 127.23.226.193:34835)
0811 18:52:53.689380 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:53.689422 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:53.690093 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:53.690441 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:53.690446 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:53.690818 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:53.691116 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:53.691123 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.692249 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.692250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:53.693701 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:53.693705 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.694195 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.694197 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:53.694322 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.694858 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:53.694867 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:53.696268 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:53.698269 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:53.698274 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:53.698276 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:53.698550 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:53.698719 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:53.698719 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:53.698720 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:53.698822 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:53.699009 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:53.699014 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:53.699125 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 18:52:53.699201 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 18:52:53.699333 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":132,"threads_started":1}
I20260811 18:52:53.699958 27631 heartbeater.cc:347] Connected to a master server at 127.23.226.254:45607
I20260811 18:52:53.700059 27631 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:53.700242 27631 heartbeater.cc:511] Master 127.23.226.254:45607 requested a full tablet report, sending...
I20260811 18:52:53.700852 27268 ts_manager.cc:194] Registered new tserver with Master: 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921)
I20260811 18:52:53.701781 27268 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:34835
I20260811 18:52:53.702309 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 27400
I20260811 18:52:53.702438 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:53.702631 24459 external_mini_cluster.cc:1428] Setting key c4fafb88bdbfe72651469161eaef545f
I20260811 18:52:53.707149 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.701020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:45607 (local address 127.23.226.193:53715)
0811 18:52:53.701159 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:53.701170 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:53.701231 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:53.701361 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:53.701362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:53.701546 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:53.701603 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:53.701604 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.702319 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.702320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:53.703083 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:53.703086 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.703534 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.703535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:53.703612 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.704017 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:53.704020 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:53.704282 (+ 262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:53.706112 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:53.706113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:53.706113 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:53.706283 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:53.706520 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:53.706521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:53.706522 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:53.706598 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:53.706896 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:53.706897 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:53.706940 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:52:53.707006 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 18:52:53.707085 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":26,"thread_start_us":84,"threads_started":1}
I20260811 18:52:53.707278 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.701061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:53715 (local address 127.23.226.254:45607)
0811 18:52:53.701107 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:53.701109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:53.701232 (+ 123us) server_negotiation.cc:407] Connection header received
0811 18:52:53.701287 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:53.701288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:53.701296 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:53.701338 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:53.701661 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.702196 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.703183 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.703452 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.703524 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.704391 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:53.704393 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:53.704393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:53.704400 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:53.705981 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.706361 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.706363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.706363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.706449 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.706664 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.706665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.706665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.706811 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:53.706883 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:53.707049 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 18:52:53.707137 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:52:53.729216 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:45607
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:53.812753 27654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:53.812986 27654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:53.813026 27654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:53.814159 27654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:53.814220 27654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:53.814253 27654 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:52:53.814281 27654 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:52:53.814316 27654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:52:53.815773 27654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:45607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:53.816040 27654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:53.816273 27654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:53.821321 27663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:53.821349 27659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:53.821375 27654 server_base.cc:1034] running on GCE node
W20260811 18:52:53.821578 27661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:53.821830 27654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:53.822021 27654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:53.823171 27654 hybrid_clock.cc:648] HybridClock initialized: now 1786474373823181 us; error 58 us; skew 500 ppm
Aug 11 18:52:53 dist-test-slave-68xk krb5kdc[27204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:53.825717 27654 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:52:53.826229 27654 webserver.cc:460] Webserver started at http://127.23.226.194:37039/ using document root <none> and password file <none>
I20260811 18:52:53.826512 27654 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:53.826563 27654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:53.826691 27654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:53.827750 27654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "f2e63b67ce684d089e0548497147f5d1"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "b02854cd39b85f5f0ea496042aef0b76"
server_key_iv: "b1cc29ee4b4ca6bec9d0905351f79520"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.828099 27654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "f2e63b67ce684d089e0548497147f5d1"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "b02854cd39b85f5f0ea496042aef0b76"
server_key_iv: "b1cc29ee4b4ca6bec9d0905351f79520"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.829437 27654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:52:53.830210 27677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:53.830448 27654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:53.830544 27654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "f2e63b67ce684d089e0548497147f5d1"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "b02854cd39b85f5f0ea496042aef0b76"
server_key_iv: "b1cc29ee4b4ca6bec9d0905351f79520"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.830618 27654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:53.838472 27654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:53.840701 27654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:53.840862 27654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:53.841421 27654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:53.841480 27654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:53.841521 27654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:53.841547 27654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:52:53 dist-test-slave-68xk krb5kdc[27204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:53.849295 27654 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:40919
I20260811 18:52:53.849439 27841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:40919 every 8 connection(s)
I20260811 18:52:53.849713 27654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:52:53.851383 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.841788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:35895 (local address 127.23.226.254:45607)
0811 18:52:53.841840 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:53.841842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:53.842137 (+ 295us) server_negotiation.cc:407] Connection header received
0811 18:52:53.842894 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:53.842895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:53.842905 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:53.842942 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:53.843890 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.844469 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.845549 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.845799 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.845876 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.848427 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:53.848429 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:53.848429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:53.848437 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:53.849926 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.850407 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.850430 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.850431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.850489 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.850743 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.850744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.850744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.850860 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:53.850929 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:53.851208 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 18:52:53.851291 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:52:53.851562 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.841771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:45607 (local address 127.23.226.194:35895)
0811 18:52:53.841978 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:53.842031 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:53.842774 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:53.843053 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:53.843058 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:53.843447 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:53.843774 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:53.843782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.844569 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.844570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:53.845456 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:53.845459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.845887 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.845889 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:53.846008 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.846512 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:53.846520 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:53.848331 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:53.850013 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:53.850020 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:53.850022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:53.850331 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:53.850562 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:53.850562 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:53.850563 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:53.850671 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:53.850933 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:53.850941 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:53.851072 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 18:52:53.851170 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 18:52:53.851340 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":109,"threads_started":1}
I20260811 18:52:53.852061 27843 heartbeater.cc:347] Connected to a master server at 127.23.226.254:45607
I20260811 18:52:53.852155 27843 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:53.852335 27843 heartbeater.cc:511] Master 127.23.226.254:45607 requested a full tablet report, sending...
I20260811 18:52:53.852725 27270 ts_manager.cc:194] Registered new tserver with Master: f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919)
I20260811 18:52:53.853235 27270 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:35895
I20260811 18:52:53.854393 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 27654
I20260811 18:52:53.854532 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:52:53.854720 24459 external_mini_cluster.cc:1428] Setting key 9a027ee713927575248ebc2e00c5215c
I20260811 18:52:53.859525 27850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.853121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:45607 (local address 127.23.226.194:38369)
0811 18:52:53.853312 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:53.853325 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:53.853408 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:53.853557 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:53.853558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:53.853740 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:53.853804 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:53.853806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.854480 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.854481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:53.855121 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:53.855124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.855535 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.855536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:53.855618 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.856076 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:53.856081 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:53.856372 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:53.858254 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:53.858268 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:53.858268 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:53.858495 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:53.858756 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:53.858756 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:53.858757 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:53.858839 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:53.859282 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:53.859283 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:53.859319 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 18:52:53.859373 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:52:53.859455 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":121,"threads_started":1}
I20260811 18:52:53.859683 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:53.853237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:38369 (local address 127.23.226.254:45607)
0811 18:52:53.853284 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:53.853286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:53.853383 (+ 97us) server_negotiation.cc:407] Connection header received
0811 18:52:53.853479 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:53.853480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:53.853490 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:53.853540 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:53.853879 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.854366 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.855196 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:53.855460 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:53.855534 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:53.856478 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:53.856480 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:53.856480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:53.856487 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:53.858176 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.858612 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.858614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.858614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.858688 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:53.858957 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:53.858958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:53.858959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:53.859190 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:53.859275 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:53.859422 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 18:52:53.859519 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:52:53.886191 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:45607
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:53.970635 27853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:53.970894 27853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:53.970939 27853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:53.972172 27853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:53.972213 27853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:53.972234 27853 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 18:52:53.972247 27853 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:52:53.972286 27853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:52:53.973722 27853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:45607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:53.973963 27853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:53.974201 27853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:53.979262 27864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:53.979509 27853 server_base.cc:1034] running on GCE node
W20260811 18:52:53.979239 27866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:53.979266 27862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:53.979784 27853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:53.979982 27853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:53.981139 27853 hybrid_clock.cc:648] HybridClock initialized: now 1786474373981123 us; error 44 us; skew 500 ppm
Aug 11 18:52:53 dist-test-slave-68xk krb5kdc[27204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:53.983757 27853 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:52:53.984141 27853 webserver.cc:460] Webserver started at http://127.23.226.195:38935/ using document root <none> and password file <none>
I20260811 18:52:53.984375 27853 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:53.984419 27853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:53.984512 27853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:53.985526 27853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "d98fc4f5c3b64632881d6b1d632798ac"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "da0cd6d283afaf1fc1b6b90423b12374"
server_key_iv: "a57b0c069387df5315d806c71af8fdc7"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.985836 27853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "d98fc4f5c3b64632881d6b1d632798ac"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "da0cd6d283afaf1fc1b6b90423b12374"
server_key_iv: "a57b0c069387df5315d806c71af8fdc7"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.987294 27853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:52:53.988026 27878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:53.988252 27853 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:52:53.988334 27853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "d98fc4f5c3b64632881d6b1d632798ac"
format_stamp: "Formatted at 2026-08-11 18:52:53 on dist-test-slave-68xk"
server_key: "da0cd6d283afaf1fc1b6b90423b12374"
server_key_iv: "a57b0c069387df5315d806c71af8fdc7"
server_key_version: "encryptionkey@0"
I20260811 18:52:53.988389 27853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:54.000197 27853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:54.002063 27853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:54.002182 27853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:54.002701 27853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:54.002748 27853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:54.002771 27853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:54.002784 27853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:54.009820 27853 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:43635
Aug 11 18:52:54 dist-test-slave-68xk krb5kdc[27204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:54.009910 28058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:43635 every 8 connection(s)
I20260811 18:52:54.010244 27853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:52:54.011750 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 27853
I20260811 18:52:54.011857 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:52:54.012042 24459 external_mini_cluster.cc:1428] Setting key f026fcf8a9858535eb9c932e099b095e
I20260811 18:52:54.013644 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.003202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:58395 (local address 127.23.226.254:45607)
0811 18:52:54.003279 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.003282 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.003473 (+ 191us) server_negotiation.cc:407] Connection header received
0811 18:52:54.003958 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.003959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.003973 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.004062 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:54.004878 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.005726 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.007313 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.007655 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.007751 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.010505 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:54.010507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:54.010508 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:54.010516 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:54.012244 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:54.012748 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:54.012749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:54.012749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:54.012820 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:54.013142 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:54.013143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:54.013143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:54.013257 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:54.013313 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.013509 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.013581 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:52:54.013804 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.003115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:45607 (local address 127.23.226.195:58395)
0811 18:52:54.003369 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.003398 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.003859 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.004112 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.004115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.004474 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:54.004770 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.004777 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.005827 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.005828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.007213 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.007217 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.007777 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.007778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.007907 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.008397 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:54.008405 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:54.010356 (+ 1951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:54.012334 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:54.012341 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:54.012343 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:54.012678 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:54.012970 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:54.012970 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:54.012971 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:54.013086 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:54.013302 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:54.013305 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:54.013407 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.013480 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.013600 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":99,"threads_started":1}
I20260811 18:52:54.014268 28059 heartbeater.cc:347] Connected to a master server at 127.23.226.254:45607
I20260811 18:52:54.014358 28059 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:54.014575 28059 heartbeater.cc:511] Master 127.23.226.254:45607 requested a full tablet report, sending...
I20260811 18:52:54.014945 27270 ts_manager.cc:194] Registered new tserver with Master: d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635)
I20260811 18:52:54.015450 27270 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:58395
I20260811 18:52:54.020355 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.015428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:47907 (local address 127.23.226.254:45607)
0811 18:52:54.015466 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.015468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.015560 (+ 92us) server_negotiation.cc:407] Connection header received
0811 18:52:54.015605 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.015606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.015616 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.015673 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:54.016006 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.016556 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.017229 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.017408 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.017458 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.018330 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:54.018331 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:54.018332 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:54.018337 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:54.019501 (+ 1164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:54.019801 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:54.019802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:54.019802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:54.019849 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:54.020002 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:54.020003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:54.020003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:54.020090 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:54.020138 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.020243 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.020298 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 18:52:54.020372 28066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.015338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:45607 (local address 127.23.226.195:47907)
0811 18:52:54.015474 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.015486 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.015549 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.015681 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.015681 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.015876 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:54.015929 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.015931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.016649 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.016649 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.017155 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.017156 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.017471 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.017472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.017516 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.017962 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:54.017967 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:54.018234 (+ 267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:54.019576 (+ 1342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:54.019577 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:54.019577 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:54.019735 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:54.019899 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:54.019900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:54.019900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:54.019953 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:54.020144 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:54.020144 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:54.020177 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.020225 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.020311 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
I20260811 18:52:54.023715 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:52:54 dist-test-slave-68xk krb5kdc[27204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:52:54 dist-test-slave-68xk krb5kdc[27204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:54.047940 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.040895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57790 (local address 127.23.226.254:45607)
0811 18:52:54.040953 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.040956 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.040965 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:52:54.040997 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.040998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.041009 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.041059 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:54.041633 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.042115 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.042880 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.043070 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.043125 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.045354 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:54.045356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:54.045356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:54.045363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:54.046779 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:54.047142 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:54.047143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:54.047143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:54.047207 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:54.047419 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:54.047420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:54.047420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:54.047527 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:54.047626 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.047753 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.047834 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:52:54.049386 27270 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:54.051048 27270 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:54.057703 28084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.053436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:32921 (local address 127.0.0.1:60256)
0811 18:52:54.053589 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.053632 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.053702 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.054224 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.054226 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.054229 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.054284 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.054287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.055278 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.055280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.056486 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.056489 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.057474 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.057474 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.057536 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.057539 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.057589 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.057620 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260811 18:52:54.057766 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.053848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60256 (local address 127.23.226.193:32921)
0811 18:52:54.054030 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.054033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.054042 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:52:54.054075 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.054076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.054103 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.054362 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.054454 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.055182 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.056574 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.057361 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.057472 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.057529 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.057603 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.057655 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260811 18:52:54.057817 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.053731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41548 (local address 127.23.226.195:43635)
0811 18:52:54.053920 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.053924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.054112 (+ 188us) server_negotiation.cc:407] Connection header received
0811 18:52:54.054188 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.054190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.054214 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.054278 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.054557 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.055629 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.056717 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.057269 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.057359 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.057418 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.057665 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.057709 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":110,"threads_started":1}
I20260811 18:52:54.057932 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.053486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:43635 (local address 127.0.0.1:41548)
0811 18:52:54.054032 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.054042 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.054108 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.054396 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.054397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.054398 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.054465 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.054467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.055714 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.055715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.056611 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.056613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.057357 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.057358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.057438 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.057452 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.057522 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.057583 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":104,"threads_started":1}
I20260811 18:52:54.058470 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.053436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:40919 (local address 127.0.0.1:38412)
0811 18:52:54.053620 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.053638 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.053702 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.054173 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.054177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.054179 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.054250 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.054252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.055672 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.055673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.056748 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.056751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.057667 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.057668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.057736 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.057739 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.058272 (+ 533us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.058350 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":2,"thread_start_us":48,"threads_started":1}
I20260811 18:52:54.058597 27499 tablet_service.cc:1467] Processing CreateTablet for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f (DEFAULT_TABLE table=test-table [id=37ca7fb0b203430981efb166efe3d374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:54.058704 27955 tablet_service.cc:1467] Processing CreateTablet for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f (DEFAULT_TABLE table=test-table [id=37ca7fb0b203430981efb166efe3d374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:54.059043 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.059082 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.053640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38412 (local address 127.23.226.194:40919)
0811 18:52:54.053976 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.053981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.053992 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:52:54.054038 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.054041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.054061 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.054336 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.054402 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.055580 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.056832 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.057571 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.058787 (+ 1216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.058897 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.058925 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.058966 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":82,"threads_started":1}
I20260811 18:52:54.059115 27955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.059729 27743 tablet_service.cc:1467] Processing CreateTablet for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f (DEFAULT_TABLE table=test-table [id=37ca7fb0b203430981efb166efe3d374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:54.060063 27743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.061939 28092 tablet_bootstrap.cc:492] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Bootstrap starting.
I20260811 18:52:54.062898 28094 tablet_bootstrap.cc:492] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Bootstrap starting.
I20260811 18:52:54.062956 28092 tablet_bootstrap.cc:654] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.063443 28092 log.cc:824] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:54.063567 28094 tablet_bootstrap.cc:654] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.063756 28097 tablet_bootstrap.cc:492] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Bootstrap starting.
I20260811 18:52:54.063936 28094 log.cc:824] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:54.064352 28092 tablet_bootstrap.cc:492] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: No bootstrap required, opened a new log
I20260811 18:52:54.064432 28092 ts_tablet_manager.cc:1397] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:52:54.064443 28097 tablet_bootstrap.cc:654] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.064779 28094 tablet_bootstrap.cc:492] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: No bootstrap required, opened a new log
I20260811 18:52:54.064782 28097 log.cc:824] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:54.064848 28094 ts_tablet_manager.cc:1397] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:54.065518 28097 tablet_bootstrap.cc:492] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: No bootstrap required, opened a new log
I20260811 18:52:54.065601 28097 ts_tablet_manager.cc:1397] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:54.066569 28092 raft_consensus.cc:348] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.066740 28092 raft_consensus.cc:374] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.066778 28092 raft_consensus.cc:729] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d98fc4f5c3b64632881d6b1d632798ac, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.066902 28092 consensus_queue.cc:260] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.066933 28094 raft_consensus.cc:348] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.067098 28094 raft_consensus.cc:374] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.067147 28094 raft_consensus.cc:729] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c4aa55456434e03b1f35b0ee6e3bc36, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.067205 28092 ts_tablet_manager.cc:1428] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:52:54.067257 28094 consensus_queue.cc:260] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.067348 28059 heartbeater.cc:503] Master 127.23.226.254:45607 was elected leader, sending a full tablet report...
I20260811 18:52:54.067509 28094 ts_tablet_manager.cc:1428] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:52:54.067555 27631 heartbeater.cc:503] Master 127.23.226.254:45607 was elected leader, sending a full tablet report...
I20260811 18:52:54.067973 28097 raft_consensus.cc:348] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.068120 28097 raft_consensus.cc:374] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.068166 28097 raft_consensus.cc:729] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e63b67ce684d089e0548497147f5d1, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.068439 28097 consensus_queue.cc:260] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.068758 27843 heartbeater.cc:503] Master 127.23.226.254:45607 was elected leader, sending a full tablet report...
I20260811 18:52:54.068756 28097 ts_tablet_manager.cc:1428] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260811 18:52:54.100481 27844 tablet.cc:2369] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:52:54.197937 27633 tablet.cc:2369] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:52:54.218987 28112 raft_consensus.cc:482] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:54.219156 28112 raft_consensus.cc:504] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.219578 28112 leader_election.cc:288] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921), d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635)
I20260811 18:52:54.222417 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.219798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:43635 (local address 127.23.226.194:51093)
0811 18:52:54.219859 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.219871 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.219918 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.220105 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.220106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.220109 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.220192 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.220194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.220869 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.220871 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.221600 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.221602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.222153 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.222154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.222235 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.222238 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.222304 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.222343 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":5}
I20260811 18:52:54.222441 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.219873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:51093 (local address 127.23.226.195:43635)
0811 18:52:54.219951 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.219954 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.219967 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:52:54.220004 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.220005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.220017 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.220088 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.220285 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.220775 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.221694 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.222072 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.222156 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.222166 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.222311 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.222354 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:52:54.222682 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.220183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:57351 (local address 127.23.226.193:32921)
0811 18:52:54.220253 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.220255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.220262 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:52:54.220285 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.220286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.220293 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.220354 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.220540 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.221000 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.221896 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.222258 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.222349 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.222358 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.222564 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.222615 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:52:54.222852 27956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e4a7bcc6284e16ac458e1d3cd1f03f" candidate_uuid: "f2e63b67ce684d089e0548497147f5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98fc4f5c3b64632881d6b1d632798ac" is_pre_election: true
I20260811 18:52:54.222931 28113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.219871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:32921 (local address 127.23.226.194:57351)
0811 18:52:54.220097 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.220107 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.220151 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.220379 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.220381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.220383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.220470 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.220472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.221086 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.221088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.221803 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.221805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.222352 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.222353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.222467 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.222470 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.222805 (+ 335us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.222849 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":147,"threads_started":1}
I20260811 18:52:54.223023 27956 raft_consensus.cc:2454] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2e63b67ce684d089e0548497147f5d1 in term 0.
I20260811 18:52:54.223289 27680 leader_election.cc:302] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d98fc4f5c3b64632881d6b1d632798ac, f2e63b67ce684d089e0548497147f5d1; no voters:
I20260811 18:52:54.223281 27551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e4a7bcc6284e16ac458e1d3cd1f03f" candidate_uuid: "f2e63b67ce684d089e0548497147f5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" is_pre_election: true
I20260811 18:52:54.223428 27551 raft_consensus.cc:2454] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2e63b67ce684d089e0548497147f5d1 in term 0.
I20260811 18:52:54.223429 28112 raft_consensus.cc:2781] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:54.223487 28112 raft_consensus.cc:482] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:54.223627 28112 raft_consensus.cc:3037] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.224368 28112 raft_consensus.cc:504] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.224515 28112 leader_election.cc:288] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [CANDIDATE]: Term 1 election: Requested vote from peers 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921), d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635)
I20260811 18:52:54.224669 27551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e4a7bcc6284e16ac458e1d3cd1f03f" candidate_uuid: "f2e63b67ce684d089e0548497147f5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36"
I20260811 18:52:54.224669 27956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e4a7bcc6284e16ac458e1d3cd1f03f" candidate_uuid: "f2e63b67ce684d089e0548497147f5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98fc4f5c3b64632881d6b1d632798ac"
I20260811 18:52:54.224754 27956 raft_consensus.cc:3037] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.224753 27551 raft_consensus.cc:3037] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.225669 27551 raft_consensus.cc:2454] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2e63b67ce684d089e0548497147f5d1 in term 1.
I20260811 18:52:54.225669 27956 raft_consensus.cc:2454] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2e63b67ce684d089e0548497147f5d1 in term 1.
I20260811 18:52:54.226250 27679 leader_election.cc:302] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c4aa55456434e03b1f35b0ee6e3bc36, f2e63b67ce684d089e0548497147f5d1; no voters:
I20260811 18:52:54.226367 28112 raft_consensus.cc:2781] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:54.226572 28112 raft_consensus.cc:686] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 1 LEADER]: Becoming Leader. State: Replica: f2e63b67ce684d089e0548497147f5d1, State: Running, Role: LEADER
I20260811 18:52:54.226687 28112 consensus_queue.cc:237] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.227569 27268 catalog_manager.cc:5495] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2e63b67ce684d089e0548497147f5d1 (127.23.226.194). New cstate: current_term: 1 leader_uuid: "f2e63b67ce684d089e0548497147f5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } health_report { overall_health: UNKNOWN } } }
W20260811 18:52:54.260896 28060 tablet.cc:2369] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 18:52:54 dist-test-slave-68xk krb5kdc[27204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474373, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:54.269763 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.263141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57792 (local address 127.23.226.254:45607)
0811 18:52:54.263214 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.263216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.263343 (+ 127us) server_negotiation.cc:407] Connection header received
0811 18:52:54.263415 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.263416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.263426 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.263469 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:54.263935 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.264419 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.265093 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.265341 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.265395 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.267416 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:54.267417 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:54.267418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:54.267424 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:54.268581 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:54.268973 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:54.268974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:54.268974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:54.269026 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:54.269208 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:54.269209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:54.269209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:54.269305 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:54.269383 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.269534 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.269631 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:52:54.269906 28133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.263105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:45607 (local address 127.0.0.1:57792)
0811 18:52:54.263259 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.263271 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.263350 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.263485 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.263485 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.263799 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:54.263852 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.263854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.264485 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.264485 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.265017 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.265018 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.265404 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.265405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.265446 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.265969 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:54.265974 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:54.267334 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:54.268651 (+ 1317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:54.268658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:54.268660 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:54.268910 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:54.269083 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:54.269083 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:54.269083 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:54.269140 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:54.269374 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:54.269383 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:54.269428 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.269511 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.269712 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":83,"thread_start_us":91,"threads_started":1}
I20260811 18:52:54.271916 27268 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:57792:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:52:54.272100 27268 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:54.273587 27499 tablet_service.cc:1467] Processing CreateTablet for tablet d2fdc251ebf3499d984dfdfff9702877 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4847b58a46174b13bef57ef07b94aea0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:52:54.273574 27743 tablet_service.cc:1467] Processing CreateTablet for tablet d2fdc251ebf3499d984dfdfff9702877 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4847b58a46174b13bef57ef07b94aea0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:52:54.273617 27955 tablet_service.cc:1467] Processing CreateTablet for tablet d2fdc251ebf3499d984dfdfff9702877 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4847b58a46174b13bef57ef07b94aea0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:52:54.273742 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2fdc251ebf3499d984dfdfff9702877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.273753 27743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2fdc251ebf3499d984dfdfff9702877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.273753 27955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2fdc251ebf3499d984dfdfff9702877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.274986 28094 tablet_bootstrap.cc:492] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: Bootstrap starting.
I20260811 18:52:54.275298 28097 tablet_bootstrap.cc:492] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: Bootstrap starting.
I20260811 18:52:54.275416 28094 tablet_bootstrap.cc:654] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.275743 28097 tablet_bootstrap.cc:654] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.276176 28094 tablet_bootstrap.cc:492] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: No bootstrap required, opened a new log
I20260811 18:52:54.276182 28092 tablet_bootstrap.cc:492] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: Bootstrap starting.
I20260811 18:52:54.276238 28094 ts_tablet_manager.cc:1397] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:54.276407 28094 raft_consensus.cc:348] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.276500 28094 raft_consensus.cc:374] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.276525 28094 raft_consensus.cc:729] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c4aa55456434e03b1f35b0ee6e3bc36, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.276574 28094 consensus_queue.cc:260] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.276684 28094 ts_tablet_manager.cc:1428] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:54.276748 28092 tablet_bootstrap.cc:654] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.276844 28110 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.276938 28110 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:54.277279 28097 tablet_bootstrap.cc:492] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: No bootstrap required, opened a new log
I20260811 18:52:54.277334 28097 ts_tablet_manager.cc:1397] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:54.277456 28097 raft_consensus.cc:348] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.277514 28097 raft_consensus.cc:374] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.277529 28097 raft_consensus.cc:729] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e63b67ce684d089e0548497147f5d1, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.277581 28097 consensus_queue.cc:260] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.277678 28097 ts_tablet_manager.cc:1428] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:54.277740 28112 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.277841 28112 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:54.278108 28092 tablet_bootstrap.cc:492] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: No bootstrap required, opened a new log
I20260811 18:52:54.278162 28092 ts_tablet_manager.cc:1397] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:54.278354 28092 raft_consensus.cc:348] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.278503 28092 raft_consensus.cc:374] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.278534 28092 raft_consensus.cc:729] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d98fc4f5c3b64632881d6b1d632798ac, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.278590 28092 consensus_queue.cc:260] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.278688 28092 ts_tablet_manager.cc:1428] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:54.278780 28104 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.278868 28104 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:54.403059 28104 raft_consensus.cc:482] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:54.403155 28104 raft_consensus.cc:504] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.403522 28104 leader_election.cc:288] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921), f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919)
I20260811 18:52:54.406267 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.403804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:57495 (local address 127.23.226.194:40919)
0811 18:52:54.403849 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.403851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.403863 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:52:54.403895 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.403896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.403905 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.403955 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.404119 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.404592 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.405565 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.405930 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.406011 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.406020 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.406163 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.406202 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:52:54.406292 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.403727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:40919 (local address 127.23.226.195:57495)
0811 18:52:54.403785 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.403797 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.403842 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.403966 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.403967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.403968 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.404047 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.404048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.404672 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.404674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.405472 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.405475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.406010 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.406011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.406090 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.406093 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.406157 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.406196 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":4}
I20260811 18:52:54.406611 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.403847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:54651 (local address 127.23.226.193:32921)
0811 18:52:54.403905 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.403907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.404067 (+ 160us) server_negotiation.cc:407] Connection header received
0811 18:52:54.404130 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.404132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.404143 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.404212 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.404378 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.404855 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.405788 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.406195 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.406284 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.406292 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.406509 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.406558 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:52:54.406612 27775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fdc251ebf3499d984dfdfff9702877" candidate_uuid: "d98fc4f5c3b64632881d6b1d632798ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e63b67ce684d089e0548497147f5d1" is_pre_election: true
I20260811 18:52:54.406739 27775 raft_consensus.cc:2454] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d98fc4f5c3b64632881d6b1d632798ac in term 0.
I20260811 18:52:54.406839 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.403767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:32921 (local address 127.23.226.195:54651)
0811 18:52:54.403981 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.403990 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.404068 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.404215 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.404216 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.404218 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.404304 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.404305 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.404941 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.404942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.405689 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.405691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.406309 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.406311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.406387 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.406392 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.406720 (+ 328us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.406770 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":147,"threads_started":1}
I20260811 18:52:54.406941 27880 leader_election.cc:302] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d98fc4f5c3b64632881d6b1d632798ac, f2e63b67ce684d089e0548497147f5d1; no voters:
I20260811 18:52:54.407094 28104 raft_consensus.cc:2781] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:54.407155 28104 raft_consensus.cc:482] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:54.407183 28104 raft_consensus.cc:3037] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.407140 27551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fdc251ebf3499d984dfdfff9702877" candidate_uuid: "d98fc4f5c3b64632881d6b1d632798ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" is_pre_election: true
I20260811 18:52:54.407253 27551 raft_consensus.cc:2454] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d98fc4f5c3b64632881d6b1d632798ac in term 0.
I20260811 18:52:54.407946 28104 raft_consensus.cc:504] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.408095 28104 leader_election.cc:288] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [CANDIDATE]: Term 1 election: Requested vote from peers 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921), f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919)
I20260811 18:52:54.408262 27775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fdc251ebf3499d984dfdfff9702877" candidate_uuid: "d98fc4f5c3b64632881d6b1d632798ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e63b67ce684d089e0548497147f5d1"
I20260811 18:52:54.408281 27551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2fdc251ebf3499d984dfdfff9702877" candidate_uuid: "d98fc4f5c3b64632881d6b1d632798ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36"
I20260811 18:52:54.408349 27551 raft_consensus.cc:3037] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.408355 27775 raft_consensus.cc:3037] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.408941 27551 raft_consensus.cc:2454] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d98fc4f5c3b64632881d6b1d632798ac in term 1.
I20260811 18:52:54.409108 27775 raft_consensus.cc:2454] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d98fc4f5c3b64632881d6b1d632798ac in term 1.
I20260811 18:52:54.409128 27881 leader_election.cc:302] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c4aa55456434e03b1f35b0ee6e3bc36, d98fc4f5c3b64632881d6b1d632798ac; no voters:
I20260811 18:52:54.409253 28104 raft_consensus.cc:2781] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:54.409440 28104 raft_consensus.cc:686] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [term 1 LEADER]: Becoming Leader. State: Replica: d98fc4f5c3b64632881d6b1d632798ac, State: Running, Role: LEADER
I20260811 18:52:54.409566 28104 consensus_queue.cc:237] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.409994 28140 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: TxnStatusTablet state changed. Reason: New leader d98fc4f5c3b64632881d6b1d632798ac. Latest consensus state: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.410074 28140 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:52:54.410247 28142 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:52:54.410388 28142 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:52:54.410456 27268 catalog_manager.cc:5495] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac reported cstate change: term changed from 0 to 1, leader changed from <none> to d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195). New cstate: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } health_report { overall_health: HEALTHY } } }
I20260811 18:52:54.425309 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.422889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41556 (local address 127.23.226.195:43635)
0811 18:52:54.422937 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.422939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.422948 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:52:54.423065 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.423065 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.423084 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.423142 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:54.423280 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.423752 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.424489 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.424694 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.424764 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.424967 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.425071 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.425163 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.425216 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.425239 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:52:54.425336 28133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.422826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:43635 (local address 127.0.0.1:41556)
0811 18:52:54.422901 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.422914 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.422965 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.423151 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.423152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.423153 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:54.423206 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.423209 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.423833 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.423835 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.424402 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.424403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.424781 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.424782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.424848 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.424862 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.425141 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.425153 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.425211 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.425263 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 18:52:54.427953 27775 raft_consensus.cc:1261] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Refusing update from remote peer d98fc4f5c3b64632881d6b1d632798ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:54.427974 27551 raft_consensus.cc:1261] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Refusing update from remote peer d98fc4f5c3b64632881d6b1d632798ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:54.428269 28140 consensus_queue.cc:1035] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:54.428406 28104 consensus_queue.cc:1035] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:54.429584 28112 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: TxnStatusTablet state changed. Reason: New leader d98fc4f5c3b64632881d6b1d632798ac. Latest consensus state: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.429694 28112 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:54.429633 28110 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: TxnStatusTablet state changed. Reason: New leader d98fc4f5c3b64632881d6b1d632798ac. Latest consensus state: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.429726 28110 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:54.430735 28140 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.430828 28140 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:52:54.430847 28110 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.430922 28110 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P 2c4aa55456434e03b1f35b0ee6e3bc36: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:54.431349 28104 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.431437 28104 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P d98fc4f5c3b64632881d6b1d632798ac: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:52:54.431659 28147 mvcc.cc:205] Tried to move back new op lower bound from 7317399037654511616 to 7317399037582180352. Current Snapshot: MvccSnapshot[applied={T|T < 7317399037654511616}]
I20260811 18:52:54.432029 28148 mvcc.cc:205] Tried to move back new op lower bound from 7317399037654511616 to 7317399037582180352. Current Snapshot: MvccSnapshot[applied={T|T < 7317399037654511616}]
I20260811 18:52:54.432009 28112 tablet_replica.cc:439] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } } }
I20260811 18:52:54.432090 28112 tablet_replica.cc:442] T d2fdc251ebf3499d984dfdfff9702877 P f2e63b67ce684d089e0548497147f5d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:52:54.432112 28149 mvcc.cc:205] Tried to move back new op lower bound from 7317399037654511616 to 7317399037582180352. Current Snapshot: MvccSnapshot[applied={T|T < 7317399037654511616}]
I20260811 18:52:54.441203 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.438451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38420 (local address 127.23.226.194:40919)
0811 18:52:54.438492 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.438494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.438502 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:52:54.438558 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.438559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.438577 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.438639 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:54.438776 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.439555 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.440384 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.440687 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.440759 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.440894 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.441016 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.441093 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.441115 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.441134 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:52:54.446699 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.443905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:58663 (local address 127.23.226.195:43635)
0811 18:52:54.443951 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.443953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.444025 (+ 72us) server_negotiation.cc:407] Connection header received
0811 18:52:54.444100 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.444100 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.444122 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.444165 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:54.444309 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.444753 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.445856 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.446041 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.446109 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.446331 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.446369 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.446506 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.446592 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.446620 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:52:54.446719 28162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.443803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:43635 (local address 127.23.226.194:58663)
0811 18:52:54.443965 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.443977 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.444040 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.444179 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.444180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.444182 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:54.444244 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.444245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.444823 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.444824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.445769 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.445771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.446120 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.446121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.446190 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.446206 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.446525 (+ 319us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.446527 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.446578 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.446627 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
I20260811 18:52:54.449393 27551 raft_consensus.cc:1261] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Refusing update from remote peer f2e63b67ce684d089e0548497147f5d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:54.449496 27956 raft_consensus.cc:1261] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Refusing update from remote peer f2e63b67ce684d089e0548497147f5d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:54.449668 28116 consensus_queue.cc:1035] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:54.449796 28112 consensus_queue.cc:1035] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:54.458532 28066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.455573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:40919 (local address 127.23.226.195:39095)
0811 18:52:54.455676 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.455686 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.455722 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.455948 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.455948 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.455950 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:54.456019 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.456021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.456707 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.456708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.457631 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.457634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.458089 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.458090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.458157 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.458172 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.458353 (+ 181us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.458355 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.458388 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.458463 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 18:52:54.458593 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.455790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:39095 (local address 127.23.226.194:40919)
0811 18:52:54.455836 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.455838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.455845 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:52:54.455865 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.455866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.455875 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.455928 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:54.456091 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.456634 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.457730 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.458019 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.458087 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.458252 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.458294 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.458347 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.458391 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.458525 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:52:54.469712 27270 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:54.469836 27270 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:54.470655 27270 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: Sending DeleteTablet for 3 replicas of tablet b1e4a7bcc6284e16ac458e1d3cd1f03f
I20260811 18:52:54.471112 27743 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:38412
I20260811 18:52:54.471253 27270 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 18:52:54.471354 27499 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:60256
W20260811 18:52:54.471415 27270 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:54.471556 27955 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e4a7bcc6284e16ac458e1d3cd1f03f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:41548
I20260811 18:52:54.472549 27499 tablet_service.cc:1467] Processing CreateTablet for tablet af5000f009b04488b26c304fad847402 (DEFAULT_TABLE table=test-table [id=6149a2230bd245048716d4aaee486d65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:54.472600 27955 tablet_service.cc:1467] Processing CreateTablet for tablet af5000f009b04488b26c304fad847402 (DEFAULT_TABLE table=test-table [id=6149a2230bd245048716d4aaee486d65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:54.472704 27955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af5000f009b04488b26c304fad847402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.472704 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af5000f009b04488b26c304fad847402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.472734 28176 tablet_replica.cc:330] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: stopping tablet replica
I20260811 18:52:54.472842 28176 raft_consensus.cc:2229] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:54.472893 28176 raft_consensus.cc:2258] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:54.473330 28176 ts_tablet_manager.cc:1905] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:54.474047 28092 tablet_bootstrap.cc:492] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: Bootstrap starting.
I20260811 18:52:54.474110 28094 tablet_bootstrap.cc:492] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: Bootstrap starting.
I20260811 18:52:54.474541 28094 tablet_bootstrap.cc:654] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.474531 27743 tablet_service.cc:1467] Processing CreateTablet for tablet af5000f009b04488b26c304fad847402 (DEFAULT_TABLE table=test-table [id=6149a2230bd245048716d4aaee486d65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:54.474630 28092 tablet_bootstrap.cc:654] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.474646 27743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af5000f009b04488b26c304fad847402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:54.475670 28097 tablet_bootstrap.cc:492] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: Bootstrap starting.
I20260811 18:52:54.476079 28097 tablet_bootstrap.cc:654] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:54.476423 28092 tablet_bootstrap.cc:492] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: No bootstrap required, opened a new log
I20260811 18:52:54.476475 28092 ts_tablet_manager.cc:1397] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:52:54.476616 28092 raft_consensus.cc:348] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.476667 28176 ts_tablet_manager.cc:1918] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:54.476686 28092 raft_consensus.cc:374] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.476734 28092 raft_consensus.cc:729] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d98fc4f5c3b64632881d6b1d632798ac, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.476790 28092 consensus_queue.cc:260] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.476904 28092 ts_tablet_manager.cc:1428] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:54.476996 28176 log.cc:1196] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/b1e4a7bcc6284e16ac458e1d3cd1f03f
I20260811 18:52:54.477288 28176 ts_tablet_manager.cc:1939] T b1e4a7bcc6284e16ac458e1d3cd1f03f P d98fc4f5c3b64632881d6b1d632798ac: Deleting consensus metadata
I20260811 18:52:54.477692 27252 catalog_manager.cc:4841] TS d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635): tablet b1e4a7bcc6284e16ac458e1d3cd1f03f (table test-table [id=37ca7fb0b203430981efb166efe3d374]) successfully deleted
I20260811 18:52:54.478000 28097 tablet_bootstrap.cc:492] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: No bootstrap required, opened a new log
I20260811 18:52:54.478056 28097 ts_tablet_manager.cc:1397] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:54.478189 28097 raft_consensus.cc:348] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.478259 28097 raft_consensus.cc:374] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.478281 28097 raft_consensus.cc:729] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e63b67ce684d089e0548497147f5d1, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.478328 28097 consensus_queue.cc:260] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.478440 28097 ts_tablet_manager.cc:1428] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:54.482365 28173 tablet_replica.cc:330] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: stopping tablet replica
I20260811 18:52:54.482494 28173 raft_consensus.cc:2229] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:54.482618 28173 raft_consensus.cc:2258] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:54.482789 28175 tablet_replica.cc:330] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: stopping tablet replica
I20260811 18:52:54.482895 28175 raft_consensus.cc:2229] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:54.482954 28175 raft_consensus.cc:2258] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:54.483415 28173 ts_tablet_manager.cc:1905] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:54.483421 28175 ts_tablet_manager.cc:1905] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:54.484993 28175 ts_tablet_manager.cc:1918] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:54.485061 28173 ts_tablet_manager.cc:1918] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:54.485143 28173 log.cc:1196] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/b1e4a7bcc6284e16ac458e1d3cd1f03f
I20260811 18:52:54.485169 28175 log.cc:1196] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/b1e4a7bcc6284e16ac458e1d3cd1f03f
I20260811 18:52:54.485433 28173 ts_tablet_manager.cc:1939] T b1e4a7bcc6284e16ac458e1d3cd1f03f P f2e63b67ce684d089e0548497147f5d1: Deleting consensus metadata
I20260811 18:52:54.485836 27250 catalog_manager.cc:4841] TS f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919): tablet b1e4a7bcc6284e16ac458e1d3cd1f03f (table test-table [id=37ca7fb0b203430981efb166efe3d374]) successfully deleted
I20260811 18:52:54.485881 28175 ts_tablet_manager.cc:1939] T b1e4a7bcc6284e16ac458e1d3cd1f03f P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting consensus metadata
I20260811 18:52:54.486284 28094 tablet_bootstrap.cc:492] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: No bootstrap required, opened a new log
I20260811 18:52:54.486333 28094 ts_tablet_manager.cc:1397] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20260811 18:52:54.486442 27251 catalog_manager.cc:4841] TS 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921): tablet b1e4a7bcc6284e16ac458e1d3cd1f03f (table test-table [id=37ca7fb0b203430981efb166efe3d374]) successfully deleted
I20260811 18:52:54.486485 28094 raft_consensus.cc:348] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.486552 28094 raft_consensus.cc:374] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:54.486577 28094 raft_consensus.cc:729] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c4aa55456434e03b1f35b0ee6e3bc36, State: Initialized, Role: FOLLOWER
I20260811 18:52:54.486618 28094 consensus_queue.cc:260] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.486720 28094 ts_tablet_manager.cc:1428] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 18:52:54.636351 28110 raft_consensus.cc:482] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:54.636485 28110 raft_consensus.cc:504] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.636812 28110 leader_election.cc:288] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919), d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635)
I20260811 18:52:54.641031 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.637162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:35955 (local address 127.23.226.195:43635)
0811 18:52:54.637222 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.637224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.637310 (+ 86us) server_negotiation.cc:407] Connection header received
0811 18:52:54.637417 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.637418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.637428 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.637490 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.637715 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.638508 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.640211 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.640567 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.640606 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.640613 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.640907 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.640959 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:52:54.641031 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.637128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:34843 (local address 127.23.226.194:40919)
0811 18:52:54.637188 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.637190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.637305 (+ 115us) server_negotiation.cc:407] Connection header received
0811 18:52:54.637413 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.637414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.637428 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.637503 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:52:54.637740 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.638494 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.640184 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.640586 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.640702 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.640712 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.640909 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.640960 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:52:54.641052 28182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.637018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:40919 (local address 127.23.226.193:34843)
0811 18:52:54.637219 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.637232 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.637311 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.637508 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.637510 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.637512 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.637648 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.637650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.638606 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.638608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.640086 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.640091 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.640684 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.640685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.640766 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.640774 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.640832 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.640891 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":104,"thread_start_us":71,"threads_started":1}
I20260811 18:52:54.641050 28181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.637018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:43635 (local address 127.23.226.193:35955)
0811 18:52:54.637220 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.637232 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.637337 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.637508 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.637510 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.637515 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:52:54.637628 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.637631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.638606 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.638608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.640110 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.640111 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.640689 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.640690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.640766 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.640776 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.640832 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.640891 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":116,"thread_start_us":71,"threads_started":1}
I20260811 18:52:54.641443 27775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af5000f009b04488b26c304fad847402" candidate_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e63b67ce684d089e0548497147f5d1" is_pre_election: true
I20260811 18:52:54.641510 27956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af5000f009b04488b26c304fad847402" candidate_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98fc4f5c3b64632881d6b1d632798ac" is_pre_election: true
I20260811 18:52:54.641566 27775 raft_consensus.cc:2454] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c4aa55456434e03b1f35b0ee6e3bc36 in term 0.
I20260811 18:52:54.641603 27956 raft_consensus.cc:2454] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c4aa55456434e03b1f35b0ee6e3bc36 in term 0.
I20260811 18:52:54.641780 27428 leader_election.cc:302] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c4aa55456434e03b1f35b0ee6e3bc36, f2e63b67ce684d089e0548497147f5d1; no voters:
I20260811 18:52:54.641958 28110 raft_consensus.cc:2781] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:54.642025 28110 raft_consensus.cc:482] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:54.642041 28110 raft_consensus.cc:3037] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.642868 28110 raft_consensus.cc:504] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.643010 28110 leader_election.cc:288] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [CANDIDATE]: Term 1 election: Requested vote from peers f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919), d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635)
I20260811 18:52:54.643198 27956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af5000f009b04488b26c304fad847402" candidate_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98fc4f5c3b64632881d6b1d632798ac"
I20260811 18:52:54.643187 27775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af5000f009b04488b26c304fad847402" candidate_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e63b67ce684d089e0548497147f5d1"
I20260811 18:52:54.643277 27775 raft_consensus.cc:3037] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.643277 27956 raft_consensus.cc:3037] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:54.644068 27956 raft_consensus.cc:2454] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c4aa55456434e03b1f35b0ee6e3bc36 in term 1.
I20260811 18:52:54.644068 27775 raft_consensus.cc:2454] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c4aa55456434e03b1f35b0ee6e3bc36 in term 1.
I20260811 18:52:54.644259 27428 leader_election.cc:302] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c4aa55456434e03b1f35b0ee6e3bc36, f2e63b67ce684d089e0548497147f5d1; no voters:
I20260811 18:52:54.644368 28110 raft_consensus.cc:2781] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:54.644546 28110 raft_consensus.cc:686] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 LEADER]: Becoming Leader. State: Replica: 2c4aa55456434e03b1f35b0ee6e3bc36, State: Running, Role: LEADER
I20260811 18:52:54.644649 28110 consensus_queue.cc:237] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:54.645407 27270 catalog_manager.cc:5495] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } health_report { overall_health: UNKNOWN } } }
I20260811 18:52:54.661175 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.658541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60264 (local address 127.23.226.193:32921)
0811 18:52:54.658595 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.658597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.658606 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:52:54.658647 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.658648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.658670 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.658757 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:54.658918 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.659441 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.660334 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.660560 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.660638 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.660808 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.660929 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.661018 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.661065 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.661089 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:52:54.666174 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.663867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:48101 (local address 127.23.226.195:43635)
0811 18:52:54.663942 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.663944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.664057 (+ 113us) server_negotiation.cc:407] Connection header received
0811 18:52:54.664099 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.664100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.664107 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.664160 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:54.664323 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.664768 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.665546 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.665743 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.665803 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.665962 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.665991 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.666038 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.666101 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.666120 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:52:54.666190 28190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.663805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:43635 (local address 127.23.226.193:48101)
0811 18:52:54.663983 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.663994 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.664057 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.664184 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.664185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.664187 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:54.664271 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.664272 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.664831 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.664832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.665469 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.665471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.665815 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.665815 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.665868 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.665882 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.666048 (+ 166us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.666049 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.666088 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.666121 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":107,"threads_started":1}
I20260811 18:52:54.668522 27775 raft_consensus.cc:1261] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Refusing update from remote peer 2c4aa55456434e03b1f35b0ee6e3bc36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:54.668546 27956 raft_consensus.cc:1261] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Refusing update from remote peer 2c4aa55456434e03b1f35b0ee6e3bc36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:54.668968 28184 consensus_queue.cc:1035] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:54.669116 28110 consensus_queue.cc:1035] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:54.677186 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.674763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:35071 (local address 127.23.226.193:32921)
0811 18:52:54.674822 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:54.674824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:54.674833 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:52:54.674857 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:54.674858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:54.674868 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:54.674931 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:54.675069 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.675579 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.676376 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.676665 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.676743 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.676919 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.676964 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.677030 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:54.677110 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 18:52:54.677132 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:52:54.677203 28066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:54.674653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:32921 (local address 127.23.226.195:35071)
0811 18:52:54.674698 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:54.674710 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:54.674765 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:54.674943 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:54.674943 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:54.674945 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:54.674994 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.674996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.675669 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.675671 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.676273 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:54.676274 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:54.676742 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:54.676744 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:54.676809 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:54.676814 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:54.677041 (+ 227us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:54.677044 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:52:54.677104 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 18:52:54.677147 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 18:52:54.677541 28148 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 18:52:56.204061 27270 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:56.204164 27270 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:56.205204 27270 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: Sending DeleteTablet for 3 replicas of tablet af5000f009b04488b26c304fad847402
I20260811 18:52:56.205466 27499 tablet_service.cc:1514] Processing DeleteTablet for tablet af5000f009b04488b26c304fad847402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:56 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:60256
I20260811 18:52:56.205528 27743 tablet_service.cc:1514] Processing DeleteTablet for tablet af5000f009b04488b26c304fad847402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:56 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:38412
I20260811 18:52:56.205549 27955 tablet_service.cc:1514] Processing DeleteTablet for tablet af5000f009b04488b26c304fad847402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:56 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:41548
I20260811 18:52:56.205766 28238 tablet_replica.cc:330] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: stopping tablet replica
I20260811 18:52:56.205883 28238 raft_consensus.cc:2229] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:56.205945 28238 raft_consensus.cc:2258] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:56.206211 28238 ts_tablet_manager.cc:1905] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:56.206534 28236 tablet_replica.cc:330] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: stopping tablet replica
I20260811 18:52:56.206652 28236 raft_consensus.cc:2229] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:56.206801 28236 raft_consensus.cc:2258] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:56.207114 28236 ts_tablet_manager.cc:1905] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:56.208102 28238 ts_tablet_manager.cc:1918] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:52:56.208174 28238 log.cc:1196] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/af5000f009b04488b26c304fad847402
I20260811 18:52:56.208418 28238 ts_tablet_manager.cc:1939] T af5000f009b04488b26c304fad847402 P f2e63b67ce684d089e0548497147f5d1: Deleting consensus metadata
I20260811 18:52:56.208771 27250 catalog_manager.cc:4841] TS f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919): tablet af5000f009b04488b26c304fad847402 (table test-table [id=6149a2230bd245048716d4aaee486d65]) successfully deleted
I20260811 18:52:56.209399 28236 ts_tablet_manager.cc:1918] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:52:56.209496 28236 log.cc:1196] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/af5000f009b04488b26c304fad847402
I20260811 18:52:56.209771 28236 ts_tablet_manager.cc:1939] T af5000f009b04488b26c304fad847402 P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting consensus metadata
I20260811 18:52:56.210127 27251 catalog_manager.cc:4841] TS 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921): tablet af5000f009b04488b26c304fad847402 (table test-table [id=6149a2230bd245048716d4aaee486d65]) successfully deleted
I20260811 18:52:56.210100 28237 tablet_replica.cc:330] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: stopping tablet replica
I20260811 18:52:56.210242 28237 raft_consensus.cc:2229] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:56.210296 28237 raft_consensus.cc:2258] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:56.210562 28237 ts_tablet_manager.cc:1905] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:56.212306 28237 ts_tablet_manager.cc:1918] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:52:56.212384 28237 log.cc:1196] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/af5000f009b04488b26c304fad847402
I20260811 18:52:56.212634 28237 ts_tablet_manager.cc:1939] T af5000f009b04488b26c304fad847402 P d98fc4f5c3b64632881d6b1d632798ac: Deleting consensus metadata
I20260811 18:52:56.213059 27252 catalog_manager.cc:4841] TS d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635): tablet af5000f009b04488b26c304fad847402 (table test-table [id=6149a2230bd245048716d4aaee486d65]) successfully deleted
Aug 11 18:52:56 dist-test-slave-68xk krb5kdc[27204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474376, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:52:56 dist-test-slave-68xk krb5kdc[27204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474376, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:56.231151 28252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:56.223575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57802 (local address 127.23.226.254:45607)
0811 18:52:56.223745 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:56.223747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:56.223779 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:52:56.223877 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:56.223878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:56.223895 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:56.223970 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:56.224575 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.225099 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.225829 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.226040 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.226116 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:56.228500 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:56.228501 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:56.228501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:56.228508 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:56.229988 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:56.230334 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:56.230335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:56.230335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:56.230391 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:56.230701 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:56.230701 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:56.230702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:56.230810 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:56.230893 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:56.231013 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 18:52:56.231080 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260811 18:52:56.232772 27270 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:56.232980 27270 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:56.234503 27743 tablet_service.cc:1467] Processing CreateTablet for tablet 0727918aff37421e9a1ca0c58cb47d64 (DEFAULT_TABLE table=test-table [id=29b178b75fef4bfd85899148e2bab74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:56.234514 27499 tablet_service.cc:1467] Processing CreateTablet for tablet 0727918aff37421e9a1ca0c58cb47d64 (DEFAULT_TABLE table=test-table [id=29b178b75fef4bfd85899148e2bab74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:56.234537 27955 tablet_service.cc:1467] Processing CreateTablet for tablet 0727918aff37421e9a1ca0c58cb47d64 (DEFAULT_TABLE table=test-table [id=29b178b75fef4bfd85899148e2bab74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:56.234664 27955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0727918aff37421e9a1ca0c58cb47d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:56.234664 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0727918aff37421e9a1ca0c58cb47d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:56.234673 27743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0727918aff37421e9a1ca0c58cb47d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:56.236002 28253 tablet_bootstrap.cc:492] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: Bootstrap starting.
I20260811 18:52:56.236338 28257 tablet_bootstrap.cc:492] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: Bootstrap starting.
I20260811 18:52:56.236555 28253 tablet_bootstrap.cc:654] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:56.236719 28257 tablet_bootstrap.cc:654] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:56.237074 28254 tablet_bootstrap.cc:492] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: Bootstrap starting.
I20260811 18:52:56.237248 28253 tablet_bootstrap.cc:492] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: No bootstrap required, opened a new log
I20260811 18:52:56.237291 28253 ts_tablet_manager.cc:1397] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:56.237414 28253 raft_consensus.cc:348] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.237500 28253 raft_consensus.cc:374] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:56.237515 28253 raft_consensus.cc:729] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e63b67ce684d089e0548497147f5d1, State: Initialized, Role: FOLLOWER
I20260811 18:52:56.237540 28254 tablet_bootstrap.cc:654] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:56.237568 28253 consensus_queue.cc:260] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.237751 28253 ts_tablet_manager.cc:1428] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:56.238193 28257 tablet_bootstrap.cc:492] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: No bootstrap required, opened a new log
I20260811 18:52:56.238229 28254 tablet_bootstrap.cc:492] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: No bootstrap required, opened a new log
I20260811 18:52:56.238255 28257 ts_tablet_manager.cc:1397] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:52:56.238293 28254 ts_tablet_manager.cc:1397] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:56.238370 28257 raft_consensus.cc:348] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.238437 28254 raft_consensus.cc:348] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.238472 28257 raft_consensus.cc:374] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:56.238502 28257 raft_consensus.cc:729] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c4aa55456434e03b1f35b0ee6e3bc36, State: Initialized, Role: FOLLOWER
I20260811 18:52:56.238502 28254 raft_consensus.cc:374] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:56.238528 28254 raft_consensus.cc:729] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d98fc4f5c3b64632881d6b1d632798ac, State: Initialized, Role: FOLLOWER
I20260811 18:52:56.238551 28257 consensus_queue.cc:260] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.238577 28254 consensus_queue.cc:260] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.238665 28257 ts_tablet_manager.cc:1428] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:56.238682 28254 ts_tablet_manager.cc:1428] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:56.394398 28203 raft_consensus.cc:482] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:56.394562 28203 raft_consensus.cc:504] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.394821 28203 leader_election.cc:288] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921), f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919)
I20260811 18:52:56.395053 27775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0727918aff37421e9a1ca0c58cb47d64" candidate_uuid: "d98fc4f5c3b64632881d6b1d632798ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e63b67ce684d089e0548497147f5d1" is_pre_election: true
I20260811 18:52:56.395143 27775 raft_consensus.cc:2454] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d98fc4f5c3b64632881d6b1d632798ac in term 0.
I20260811 18:52:56.395071 27548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0727918aff37421e9a1ca0c58cb47d64" candidate_uuid: "d98fc4f5c3b64632881d6b1d632798ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" is_pre_election: true
I20260811 18:52:56.395220 27548 raft_consensus.cc:2454] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d98fc4f5c3b64632881d6b1d632798ac in term 0.
I20260811 18:52:56.395398 27880 leader_election.cc:302] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d98fc4f5c3b64632881d6b1d632798ac, f2e63b67ce684d089e0548497147f5d1; no voters:
I20260811 18:52:56.395520 28203 raft_consensus.cc:2781] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:56.395586 28203 raft_consensus.cc:482] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:56.395612 28203 raft_consensus.cc:3037] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:56.396363 28203 raft_consensus.cc:504] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.396499 28203 leader_election.cc:288] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [CANDIDATE]: Term 1 election: Requested vote from peers 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921), f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919)
I20260811 18:52:56.396689 27548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0727918aff37421e9a1ca0c58cb47d64" candidate_uuid: "d98fc4f5c3b64632881d6b1d632798ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36"
I20260811 18:52:56.396674 27775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0727918aff37421e9a1ca0c58cb47d64" candidate_uuid: "d98fc4f5c3b64632881d6b1d632798ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e63b67ce684d089e0548497147f5d1"
I20260811 18:52:56.396766 27548 raft_consensus.cc:3037] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:56.396790 27775 raft_consensus.cc:3037] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:56.397437 27548 raft_consensus.cc:2454] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d98fc4f5c3b64632881d6b1d632798ac in term 1.
I20260811 18:52:56.397553 27775 raft_consensus.cc:2454] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d98fc4f5c3b64632881d6b1d632798ac in term 1.
I20260811 18:52:56.397615 27881 leader_election.cc:302] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c4aa55456434e03b1f35b0ee6e3bc36, d98fc4f5c3b64632881d6b1d632798ac; no voters:
I20260811 18:52:56.397723 28203 raft_consensus.cc:2781] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:56.397800 28203 raft_consensus.cc:686] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 1 LEADER]: Becoming Leader. State: Replica: d98fc4f5c3b64632881d6b1d632798ac, State: Running, Role: LEADER
I20260811 18:52:56.397857 28203 consensus_queue.cc:237] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.398584 27270 catalog_manager.cc:5495] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac reported cstate change: term changed from 0 to 1, leader changed from <none> to d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195). New cstate: current_term: 1 leader_uuid: "d98fc4f5c3b64632881d6b1d632798ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } health_report { overall_health: HEALTHY } } }
I20260811 18:52:56.423252 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:56.420800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.23.226.195:43635)
0811 18:52:56.420961 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:56.420963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:56.420971 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:52:56.420998 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:56.420999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:56.421008 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:56.421078 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:56.421200 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.421706 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.422571 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.422790 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.422842 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:56.422966 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:56.423001 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:56.423042 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:56.423119 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:52:56.423138 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":112,"threads_started":1}
I20260811 18:52:56.427896 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:56.425661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:57321 (local address 127.23.226.195:43635)
0811 18:52:56.425719 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:56.425721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:56.425730 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:52:56.425800 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:56.425801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:56.425811 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:56.425864 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:56.425983 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.426511 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.427243 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.427438 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.427510 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:56.427642 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:56.427673 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:56.427728 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:56.427801 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 18:52:56.427817 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:52:56.427954 28272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:56.425514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:43635 (local address 127.23.226.195:57321)
0811 18:52:56.425658 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:56.425667 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:56.425734 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:56.425871 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:56.425872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:56.425873 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:52:56.425909 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:56.425911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.426604 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.426605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:56.427158 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:56.427159 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.427508 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.427509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:56.427559 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:56.427568 (+ 9us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:52:56.427729 (+ 161us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:52:56.427732 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:52:56.427794 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 18:52:56.427835 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":94,"threads_started":1}
I20260811 18:52:56.429811 27775 raft_consensus.cc:1261] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Refusing update from remote peer d98fc4f5c3b64632881d6b1d632798ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:56.429826 27548 raft_consensus.cc:1261] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Refusing update from remote peer d98fc4f5c3b64632881d6b1d632798ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:56.430027 28203 consensus_queue.cc:1035] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:56.430142 28199 consensus_queue.cc:1035] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:56.440817 27270 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:56.440928 27270 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:56.441598 27270 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: Sending DeleteTablet for 3 replicas of tablet 0727918aff37421e9a1ca0c58cb47d64
I20260811 18:52:56.441847 27499 tablet_service.cc:1514] Processing DeleteTablet for tablet 0727918aff37421e9a1ca0c58cb47d64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:56 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:60256
I20260811 18:52:56.441892 27955 tablet_service.cc:1514] Processing DeleteTablet for tablet 0727918aff37421e9a1ca0c58cb47d64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:56 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:41548
I20260811 18:52:56.441952 28236 tablet_replica.cc:330] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: stopping tablet replica
I20260811 18:52:56.441972 28237 tablet_replica.cc:330] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: stopping tablet replica
I20260811 18:52:56.442003 28236 raft_consensus.cc:2229] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:56.442018 28237 raft_consensus.cc:2229] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:56.442039 28236 raft_consensus.cc:2258] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:56.442124 28237 raft_consensus.cc:2258] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:56.442101 27270 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:52:56.442233 27270 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:52:56.442572 28237 ts_tablet_manager.cc:1905] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:56.442883 28236 ts_tablet_manager.cc:1905] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:56.443457 27499 tablet_service.cc:1467] Processing CreateTablet for tablet 637fc4efabea400e92c52bb0b7457211 (DEFAULT_TABLE table=test-table [id=7bd423cd5e0b4a4db8b5f2337907ce5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:56.443583 27499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 637fc4efabea400e92c52bb0b7457211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:56.444288 28237 ts_tablet_manager.cc:1918] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:56.444340 28237 log.cc:1196] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/0727918aff37421e9a1ca0c58cb47d64
I20260811 18:52:56.444564 28237 ts_tablet_manager.cc:1939] T 0727918aff37421e9a1ca0c58cb47d64 P d98fc4f5c3b64632881d6b1d632798ac: Deleting consensus metadata
I20260811 18:52:56.444756 28236 ts_tablet_manager.cc:1918] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:56.444808 28236 log.cc:1196] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/0727918aff37421e9a1ca0c58cb47d64
I20260811 18:52:56.444880 28257 tablet_bootstrap.cc:492] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36: Bootstrap starting.
I20260811 18:52:56.445025 28236 ts_tablet_manager.cc:1939] T 0727918aff37421e9a1ca0c58cb47d64 P 2c4aa55456434e03b1f35b0ee6e3bc36: Deleting consensus metadata
I20260811 18:52:56.445163 27955 tablet_service.cc:1467] Processing CreateTablet for tablet 637fc4efabea400e92c52bb0b7457211 (DEFAULT_TABLE table=test-table [id=7bd423cd5e0b4a4db8b5f2337907ce5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:56.445210 28257 tablet_bootstrap.cc:654] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:56.445272 27955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 637fc4efabea400e92c52bb0b7457211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:56.445729 28257 tablet_bootstrap.cc:492] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36: No bootstrap required, opened a new log
I20260811 18:52:56.445732 27251 catalog_manager.cc:4841] TS 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921): tablet 0727918aff37421e9a1ca0c58cb47d64 (table test-table [id=29b178b75fef4bfd85899148e2bab74c]) successfully deleted
I20260811 18:52:56.445780 28257 ts_tablet_manager.cc:1397] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:56.445905 28257 raft_consensus.cc:348] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.445982 28257 raft_consensus.cc:374] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:56.446012 28257 raft_consensus.cc:729] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c4aa55456434e03b1f35b0ee6e3bc36, State: Initialized, Role: FOLLOWER
I20260811 18:52:56.446055 28257 consensus_queue.cc:260] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.446152 28257 ts_tablet_manager.cc:1428] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:56.446405 28254 tablet_bootstrap.cc:492] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: Bootstrap starting.
I20260811 18:52:56.446481 27252 catalog_manager.cc:4841] TS d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635): tablet 0727918aff37421e9a1ca0c58cb47d64 (table test-table [id=29b178b75fef4bfd85899148e2bab74c]) successfully deleted
I20260811 18:52:56.446756 27743 tablet_service.cc:1514] Processing DeleteTablet for tablet 0727918aff37421e9a1ca0c58cb47d64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:56 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:38412
I20260811 18:52:56.446790 28254 tablet_bootstrap.cc:654] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:56.446914 27742 tablet_service.cc:1467] Processing CreateTablet for tablet 637fc4efabea400e92c52bb0b7457211 (DEFAULT_TABLE table=test-table [id=7bd423cd5e0b4a4db8b5f2337907ce5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:52:56.447022 27742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 637fc4efabea400e92c52bb0b7457211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:56.448048 28253 tablet_bootstrap.cc:492] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: Bootstrap starting.
I20260811 18:52:56.448073 28238 tablet_replica.cc:330] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: stopping tablet replica
I20260811 18:52:56.448154 28238 raft_consensus.cc:2229] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:56.448194 28238 raft_consensus.cc:2258] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:56.448414 28253 tablet_bootstrap.cc:654] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:56.448488 28238 ts_tablet_manager.cc:1905] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:56.449076 28253 tablet_bootstrap.cc:492] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: No bootstrap required, opened a new log
I20260811 18:52:56.449134 28253 ts_tablet_manager.cc:1397] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:52:56.449229 28253 raft_consensus.cc:348] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.449306 28253 raft_consensus.cc:374] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:56.449326 28253 raft_consensus.cc:729] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e63b67ce684d089e0548497147f5d1, State: Initialized, Role: FOLLOWER
I20260811 18:52:56.449365 28253 consensus_queue.cc:260] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.449452 28253 ts_tablet_manager.cc:1428] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:56.450032 28238 ts_tablet_manager.cc:1918] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:52:56.450101 28238 log.cc:1196] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/0727918aff37421e9a1ca0c58cb47d64
I20260811 18:52:56.450295 28238 ts_tablet_manager.cc:1939] T 0727918aff37421e9a1ca0c58cb47d64 P f2e63b67ce684d089e0548497147f5d1: Deleting consensus metadata
I20260811 18:52:56.450654 27250 catalog_manager.cc:4841] TS f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919): tablet 0727918aff37421e9a1ca0c58cb47d64 (table test-table [id=29b178b75fef4bfd85899148e2bab74c]) successfully deleted
I20260811 18:52:56.450735 28254 tablet_bootstrap.cc:492] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: No bootstrap required, opened a new log
I20260811 18:52:56.450790 28254 ts_tablet_manager.cc:1397] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 18:52:56.450932 28254 raft_consensus.cc:348] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.451004 28254 raft_consensus.cc:374] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:56.451038 28254 raft_consensus.cc:729] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d98fc4f5c3b64632881d6b1d632798ac, State: Initialized, Role: FOLLOWER
I20260811 18:52:56.451086 28254 consensus_queue.cc:260] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.451174 28254 ts_tablet_manager.cc:1428] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:56.549486 28261 raft_consensus.cc:482] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:52:56.549597 28261 raft_consensus.cc:504] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.549824 28261 leader_election.cc:288] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921), d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635)
I20260811 18:52:56.550125 27548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "637fc4efabea400e92c52bb0b7457211" candidate_uuid: "f2e63b67ce684d089e0548497147f5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" is_pre_election: true
I20260811 18:52:56.550216 27548 raft_consensus.cc:2454] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2e63b67ce684d089e0548497147f5d1 in term 0.
I20260811 18:52:56.550181 27956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "637fc4efabea400e92c52bb0b7457211" candidate_uuid: "f2e63b67ce684d089e0548497147f5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98fc4f5c3b64632881d6b1d632798ac" is_pre_election: true
I20260811 18:52:56.550329 27956 raft_consensus.cc:2454] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2e63b67ce684d089e0548497147f5d1 in term 0.
I20260811 18:52:56.550460 27679 leader_election.cc:302] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c4aa55456434e03b1f35b0ee6e3bc36, f2e63b67ce684d089e0548497147f5d1; no voters:
I20260811 18:52:56.550599 28261 raft_consensus.cc:2781] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:52:56.550668 28261 raft_consensus.cc:482] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:52:56.550701 28261 raft_consensus.cc:3037] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:56.551558 28261 raft_consensus.cc:504] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.551776 28261 leader_election.cc:288] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [CANDIDATE]: Term 1 election: Requested vote from peers 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921), d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635)
I20260811 18:52:56.551959 27548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "637fc4efabea400e92c52bb0b7457211" candidate_uuid: "f2e63b67ce684d089e0548497147f5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36"
I20260811 18:52:56.551954 27956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "637fc4efabea400e92c52bb0b7457211" candidate_uuid: "f2e63b67ce684d089e0548497147f5d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d98fc4f5c3b64632881d6b1d632798ac"
I20260811 18:52:56.552043 27548 raft_consensus.cc:3037] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:56.552045 27956 raft_consensus.cc:3037] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:56.552919 27548 raft_consensus.cc:2454] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2e63b67ce684d089e0548497147f5d1 in term 1.
I20260811 18:52:56.552911 27956 raft_consensus.cc:2454] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2e63b67ce684d089e0548497147f5d1 in term 1.
I20260811 18:52:56.553133 27679 leader_election.cc:302] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c4aa55456434e03b1f35b0ee6e3bc36, f2e63b67ce684d089e0548497147f5d1; no voters:
I20260811 18:52:56.553263 28261 raft_consensus.cc:2781] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:56.553400 28261 raft_consensus.cc:686] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 1 LEADER]: Becoming Leader. State: Replica: f2e63b67ce684d089e0548497147f5d1, State: Running, Role: LEADER
I20260811 18:52:56.553462 28261 consensus_queue.cc:237] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } }
I20260811 18:52:56.554278 27270 catalog_manager.cc:5495] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2e63b67ce684d089e0548497147f5d1 (127.23.226.194). New cstate: current_term: 1 leader_uuid: "f2e63b67ce684d089e0548497147f5d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2e63b67ce684d089e0548497147f5d1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 } health_report { overall_health: UNKNOWN } } }
I20260811 18:52:56.569106 28287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:56.566783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38432 (local address 127.23.226.194:40919)
0811 18:52:56.566977 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:56.566978 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:56.566984 (+ 6us) server_negotiation.cc:407] Connection header received
0811 18:52:56.567002 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:56.567003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:56.567013 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:56.567081 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:52:56.567206 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.567689 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.568408 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:56.568625 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:56.568700 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:56.568834 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:52:56.568875 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:52:56.568929 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:56.568992 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 18:52:56.569015 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":123,"threads_started":1}
I20260811 18:52:56.571521 27956 raft_consensus.cc:1261] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Refusing update from remote peer f2e63b67ce684d089e0548497147f5d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:56.571573 27548 raft_consensus.cc:1261] T 637fc4efabea400e92c52bb0b7457211 P 2c4aa55456434e03b1f35b0ee6e3bc36 [term 1 FOLLOWER]: Refusing update from remote peer f2e63b67ce684d089e0548497147f5d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:52:56.571748 28285 consensus_queue.cc:1035] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d98fc4f5c3b64632881d6b1d632798ac" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 43635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:52:56.571852 28261 consensus_queue.cc:1035] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c4aa55456434e03b1f35b0ee6e3bc36" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 32921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:52:56.576414 28204 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 18:52:58.095966 27268 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:58.096084 27268 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:52:58.097067 27268 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6b21284ba0741008f8c38dd01e2c2df: Sending DeleteTablet for 3 replicas of tablet 637fc4efabea400e92c52bb0b7457211
I20260811 18:52:58.097391 27955 tablet_service.cc:1514] Processing DeleteTablet for tablet 637fc4efabea400e92c52bb0b7457211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:58 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:41548
I20260811 18:52:58.097477 27742 tablet_service.cc:1514] Processing DeleteTablet for tablet 637fc4efabea400e92c52bb0b7457211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:58 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:38412
I20260811 18:52:58.097601 27499 tablet_service.cc:1514] Processing DeleteTablet for tablet 637fc4efabea400e92c52bb0b7457211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:52:58 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:60256
I20260811 18:52:58.097662 28335 tablet_replica.cc:330] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: stopping tablet replica
I20260811 18:52:58.097648 28333 tablet_replica.cc:330] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: stopping tablet replica
I20260811 18:52:58.097673 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 27400
I20260811 18:52:58.097733 28333 raft_consensus.cc:2229] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:52:58.098304 28333 raft_consensus.cc:2258] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:58.102452 28333 ts_tablet_manager.cc:1905] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:58.097721 28335 raft_consensus.cc:2229] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:52:58.104212 28335 raft_consensus.cc:2258] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:52:58.104524 28335 ts_tablet_manager.cc:1905] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:52:58.104934 28333 ts_tablet_manager.cc:1918] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:52:58.105016 28333 log.cc:1196] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/637fc4efabea400e92c52bb0b7457211
I20260811 18:52:58.105358 28333 ts_tablet_manager.cc:1939] T 637fc4efabea400e92c52bb0b7457211 P d98fc4f5c3b64632881d6b1d632798ac: Deleting consensus metadata
I20260811 18:52:58.105840 27252 catalog_manager.cc:4841] TS d98fc4f5c3b64632881d6b1d632798ac (127.23.226.195:43635): tablet 637fc4efabea400e92c52bb0b7457211 (table test-table [id=7bd423cd5e0b4a4db8b5f2337907ce5d]) successfully deleted
I20260811 18:52:58.106040 28335 ts_tablet_manager.cc:1918] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 18:52:58.106101 28335 log.cc:1196] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/637fc4efabea400e92c52bb0b7457211
I20260811 18:52:58.106343 28335 ts_tablet_manager.cc:1939] T 637fc4efabea400e92c52bb0b7457211 P f2e63b67ce684d089e0548497147f5d1: Deleting consensus metadata
I20260811 18:52:58.106720 27250 catalog_manager.cc:4841] TS f2e63b67ce684d089e0548497147f5d1 (127.23.226.194:40919): tablet 637fc4efabea400e92c52bb0b7457211 (table test-table [id=7bd423cd5e0b4a4db8b5f2337907ce5d]) successfully deleted
W20260811 18:52:58.112684 27251 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:32921 (error 108)
I20260811 18:52:58.112929 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 27654
I20260811 18:52:58.115469 28341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:58.115198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:32921 (local address 127.0.0.1:60276)
0811 18:52:58.115354 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:58.115413 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:32921: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
W20260811 18:52:58.118155 27251 catalog_manager.cc:4584] TS 2c4aa55456434e03b1f35b0ee6e3bc36 (127.23.226.193:32921): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 637fc4efabea400e92c52bb0b7457211: Network error: Client connection negotiation failed: client connection to 127.23.226.193:32921: connect: Connection refused (error 111)
I20260811 18:52:58.126962 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 27853
I20260811 18:52:58.139544 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 27227
2026-08-11T18:52:58Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6203 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:52:58 dist-test-slave-68xk krb5kdc[28345](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:52:58 dist-test-slave-68xk krb5kdc[28345](info): set up 2 sockets
Aug 11 18:52:58 dist-test-slave-68xk krb5kdc[28345](info): commencing operation
krb5kdc: starting...
W20260811 18:52:59.427167 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:52:59 dist-test-slave-68xk krb5kdc[28345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:52:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:52:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:52:59.554535 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:33057
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:33057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:59.645931 28367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:59.646145 28367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:59.646174 28367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:59.647378 28367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:52:59.647424 28367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:59.647439 28367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:59.647452 28367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:52:59.647509 28367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:52:59.649056 28367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:33057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:33057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:59.649340 28367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:59.649580 28367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:59.654927 28377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:59.654928 28378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:59.654959 28380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:59.655042 28367 server_base.cc:1034] running on GCE node
I20260811 18:52:59.655423 28367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:59.655694 28367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:59.656850 28367 hybrid_clock.cc:648] HybridClock initialized: now 1786474379656838 us; error 34 us; skew 500 ppm
Aug 11 18:52:59 dist-test-slave-68xk krb5kdc[28345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474379, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:59.663201 28367 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:52:59.663633 28367 webserver.cc:460] Webserver started at http://127.23.226.254:38603/ using document root <none> and password file <none>
I20260811 18:52:59.663858 28367 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:59.663905 28367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:59.664003 28367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:59.665140 28367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "6e92a12d75814799923336b22d8ee34a"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-68xk"
server_key: "f507aaa6d39ddbbd3c6593e58af15e60"
server_key_iv: "8a66fef5012f094d69ca8e62a7d0f982"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.665478 28367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "6e92a12d75814799923336b22d8ee34a"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-68xk"
server_key: "f507aaa6d39ddbbd3c6593e58af15e60"
server_key_iv: "8a66fef5012f094d69ca8e62a7d0f982"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.666960 28367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:52:59.667727 28396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:59.667909 28367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:52:59.668030 28367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "6e92a12d75814799923336b22d8ee34a"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-68xk"
server_key: "f507aaa6d39ddbbd3c6593e58af15e60"
server_key_iv: "8a66fef5012f094d69ca8e62a7d0f982"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.668133 28367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:59.681823 28367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:59.684701 28367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:59.684881 28367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:59.690627 28367 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:33057
I20260811 18:52:59.690677 28477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:33057 every 8 connection(s)
I20260811 18:52:59.691100 28367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:52:59.692296 28478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:52:59.694617 28478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a: Bootstrap starting.
I20260811 18:52:59.695174 28478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a: Neither blocks nor log segments found. Creating new log.
I20260811 18:52:59.695422 28478 log.cc:824] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:52:59.696107 28478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a: No bootstrap required, opened a new log
I20260811 18:52:59.697661 28478 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92a12d75814799923336b22d8ee34a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33057 } }
I20260811 18:52:59.697803 28478 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:52:59.697825 28478 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e92a12d75814799923336b22d8ee34a, State: Initialized, Role: FOLLOWER
I20260811 18:52:59.697958 28478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92a12d75814799923336b22d8ee34a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33057 } }
I20260811 18:52:59.698043 28478 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:52:59.698066 28478 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:52:59.698093 28478 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:52:59.698688 28478 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92a12d75814799923336b22d8ee34a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33057 } }
I20260811 18:52:59.698778 28478 leader_election.cc:302] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e92a12d75814799923336b22d8ee34a; no voters:
I20260811 18:52:59.698904 28478 leader_election.cc:288] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:52:59.698966 28481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:52:59.699131 28478 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:52:59.699148 28481 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [term 1 LEADER]: Becoming Leader. State: Replica: 6e92a12d75814799923336b22d8ee34a, State: Running, Role: LEADER
I20260811 18:52:59.699399 28481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92a12d75814799923336b22d8ee34a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33057 } }
I20260811 18:52:59.700295 28482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e92a12d75814799923336b22d8ee34a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92a12d75814799923336b22d8ee34a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33057 } } }
I20260811 18:52:59.700305 28484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e92a12d75814799923336b22d8ee34a. Latest consensus state: current_term: 1 leader_uuid: "6e92a12d75814799923336b22d8ee34a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92a12d75814799923336b22d8ee34a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33057 } } }
I20260811 18:52:59.700416 28482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:59.700423 28484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a [sys.catalog]: This master's current role is: LEADER
I20260811 18:52:59.700691 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 28367
I20260811 18:52:59.700796 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:52:59.700990 24459 external_mini_cluster.cc:1428] Setting key df2d808cf9b7f197164fb9cfa0db744a
I20260811 18:52:59.701654 28505 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:52:59.702224 28505 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:52:59.703891 28505 catalog_manager.cc:1347] Generated new cluster ID: ff9a58839b60474aafdbb94e0ba27c89
I20260811 18:52:59.703951 28505 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:52:59 dist-test-slave-68xk krb5kdc[28345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:59.714951 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:59.701488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54348 (local address 127.23.226.254:33057)
0811 18:52:59.702964 (+ 1476us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:59.702974 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:59.703009 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:52:59.703129 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:59.703135 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:59.703191 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:59.703337 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:59.704251 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.705681 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.706843 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.707573 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.707690 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:59.710836 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:59.710841 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:59.710841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:59.710854 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:59.712912 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:59.713319 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:59.713322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:59.713323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:59.713439 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:59.713641 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:59.713642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:59.713642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:59.713947 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:59.714091 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:59.714548 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 18:52:59.714698 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1413,"thread_start_us":108,"threads_started":1}
I20260811 18:52:59.717118 28505 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:52:59.717823 28505 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:52:59.729732 28505 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e92a12d75814799923336b22d8ee34a: Generated new TSK 0
I20260811 18:52:59.729928 28505 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:52:59.765861 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33057
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:52:59.852218 28524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:52:59.852447 28524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:52:59.852487 28524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:52:59.853623 28524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:52:59.853688 28524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:52:59.853732 28524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:52:59.855273 28524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:52:59.855541 28524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:52:59.855774 28524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:52:59.860787 28533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:59.860805 28534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:52:59.860757 28538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:52:59.861109 28524 server_base.cc:1034] running on GCE node
I20260811 18:52:59.861353 28524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:52:59.861632 28524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:52:59.862810 28524 hybrid_clock.cc:648] HybridClock initialized: now 1786474379862791 us; error 32 us; skew 500 ppm
Aug 11 18:52:59 dist-test-slave-68xk krb5kdc[28345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474379, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:52:59.865417 28524 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:52:59.865937 28524 webserver.cc:460] Webserver started at http://127.23.226.193:35259/ using document root <none> and password file <none>
I20260811 18:52:59.866180 28524 fs_manager.cc:359] Metadata directory not provided
I20260811 18:52:59.866251 28524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:52:59.866403 28524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:52:59.867501 28524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "19fd6e8146b84b96bc795e9057fddb34"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-68xk"
server_key: "84892b25527cee46d980b5fae87bf284"
server_key_iv: "57bdea3f07216b48f479045ca50572d4"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.867887 28524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "19fd6e8146b84b96bc795e9057fddb34"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-68xk"
server_key: "84892b25527cee46d980b5fae87bf284"
server_key_iv: "57bdea3f07216b48f479045ca50572d4"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.869246 28524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:52:59.870000 28552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:59.870170 28524 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:52:59.870409 28524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "19fd6e8146b84b96bc795e9057fddb34"
format_stamp: "Formatted at 2026-08-11 18:52:59 on dist-test-slave-68xk"
server_key: "84892b25527cee46d980b5fae87bf284"
server_key_iv: "57bdea3f07216b48f479045ca50572d4"
server_key_version: "encryptionkey@0"
I20260811 18:52:59.870550 28524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:52:59.889304 28524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:52:59.891873 28524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:52:59.892069 28524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:52:59.892344 28524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:52:59.892721 28524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:52:59.892792 28524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:59.892832 28524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:52:59.892887 28524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:52:59.899719 28524 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:33047
I20260811 18:52:59.899776 28729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:33047 every 8 connection(s)
I20260811 18:52:59.900157 28524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:52:59.901979 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 28524
I20260811 18:52:59.902078 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:52:59.902285 24459 external_mini_cluster.cc:1428] Setting key aea3010f7856c46cf3aa9fd0c251d8ae
Aug 11 18:52:59 dist-test-slave-68xk krb5kdc[28345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474379, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:52:59.910966 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:59.901010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:58743 (local address 127.23.226.254:33057)
0811 18:52:59.901072 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:52:59.901074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:52:59.901320 (+ 246us) server_negotiation.cc:407] Connection header received
0811 18:52:59.901852 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:52:59.901853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:52:59.901868 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:52:59.901922 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:52:59.903291 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.903843 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.905240 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.905573 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.905661 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:59.907828 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:52:59.907830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:52:59.907830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:52:59.907839 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:52:59.909546 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:59.909948 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:59.909949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:59.909950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:59.910021 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:52:59.910273 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:52:59.910274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:52:59.910274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:52:59.910448 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:52:59.910517 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:52:59.910771 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 18:52:59.910866 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:52:59.910996 28734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:52:59.900986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33057 (local address 127.23.226.193:58743)
0811 18:52:59.901176 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 18:52:59.901219 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:52:59.901714 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:52:59.902017 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:52:59.902022 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:52:59.902878 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:52:59.903171 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:59.903178 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.903939 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.903941 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:59.905134 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:52:59.905136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:52:59.905667 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:52:59.905668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:52:59.905774 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:52:59.906303 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:52:59.906312 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:52:59.907733 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:52:59.909642 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:59.909648 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:59.909650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:59.909867 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:59.910095 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:52:59.910096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:52:59.910096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:52:59.910202 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:52:59.910517 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:52:59.910522 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:52:59.910638 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 18:52:59.910719 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 18:52:59.910837 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
I20260811 18:52:59.911566 28730 heartbeater.cc:347] Connected to a master server at 127.23.226.254:33057
I20260811 18:52:59.911664 28730 heartbeater.cc:464] Registering TS with master...
I20260811 18:52:59.911852 28730 heartbeater.cc:511] Master 127.23.226.254:33057 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
I20260811 18:52:59.912384 28417 ts_manager.cc:194] Registered new tserver with Master: 19fd6e8146b84b96bc795e9057fddb34 (127.23.226.193:33047)
I20260811 18:52:59.913012 28417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:58743
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:52:59.929962 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33057
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:00.018309 28738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:00.018612 28738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:00.018641 28738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:00.019819 28738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:00.019858 28738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:00.019886 28738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:00.021317 28738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:00.021523 28738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:00.021716 28738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:00.026885 28755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:00.026957 28753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:00.027091 28738 server_base.cc:1034] running on GCE node
W20260811 18:53:00.027127 28750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:00.027405 28738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:00.027606 28738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:00.028753 28738 hybrid_clock.cc:648] HybridClock initialized: now 1786474380028730 us; error 42 us; skew 500 ppm
Aug 11 18:53:00 dist-test-slave-68xk krb5kdc[28345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474380, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:00.031527 28738 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:53:00.032051 28738 webserver.cc:460] Webserver started at http://127.23.226.194:44741/ using document root <none> and password file <none>
I20260811 18:53:00.032320 28738 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:00.032393 28738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:00.032545 28738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:00.033612 28738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "1f4b244716734e8297050e262d660b1f"
format_stamp: "Formatted at 2026-08-11 18:53:00 on dist-test-slave-68xk"
server_key: "2a93cbe769b91eb409d5347b97690445"
server_key_iv: "66a24f084300c4dc47c39332451e3594"
server_key_version: "encryptionkey@0"
I20260811 18:53:00.033985 28738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "1f4b244716734e8297050e262d660b1f"
format_stamp: "Formatted at 2026-08-11 18:53:00 on dist-test-slave-68xk"
server_key: "2a93cbe769b91eb409d5347b97690445"
server_key_iv: "66a24f084300c4dc47c39332451e3594"
server_key_version: "encryptionkey@0"
I20260811 18:53:00.035460 28738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:00.036211 28763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:00.036402 28738 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:00.036514 28738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "1f4b244716734e8297050e262d660b1f"
format_stamp: "Formatted at 2026-08-11 18:53:00 on dist-test-slave-68xk"
server_key: "2a93cbe769b91eb409d5347b97690445"
server_key_iv: "66a24f084300c4dc47c39332451e3594"
server_key_version: "encryptionkey@0"
I20260811 18:53:00.036590 28738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:00.058579 28738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:00.060685 28738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:00.060848 28738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:00.061079 28738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:00.061414 28738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:00.061470 28738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:00.061513 28738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:00.061542 28738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:00.067700 28738 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:40019
I20260811 18:53:00.067782 28956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:40019 every 8 connection(s)
I20260811 18:53:00.068110 28738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:53:00 dist-test-slave-68xk krb5kdc[28345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474380, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:00.076171 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 28738
I20260811 18:53:00.076287 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:00.076489 24459 external_mini_cluster.cc:1428] Setting key 00b9e1cd4393349e23ff1e51bd432e6f
I20260811 18:53:00.078389 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:00.068897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:59415 (local address 127.23.226.254:33057)
0811 18:53:00.068949 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:00.068952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:00.069224 (+ 272us) server_negotiation.cc:407] Connection header received
0811 18:53:00.069724 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:00.069725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:00.069736 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:00.069796 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:00.070823 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:00.071372 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:00.072526 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:00.072718 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:00.072780 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:00.075120 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:00.075122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:00.075122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:00.075129 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:00.076790 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:00.077292 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:00.077293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:00.077294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:00.077363 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:00.077700 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:00.077701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:00.077701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:00.077819 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:00.077887 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:00.078248 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 18:53:00.078323 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:53:00.078727 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:00.068880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33057 (local address 127.23.226.194:59415)
0811 18:53:00.069069 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:00.069106 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:00.069636 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:00.069849 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:00.069852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:00.070507 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:00.070744 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:00.070750 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:00.071480 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:00.071481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:00.072441 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:00.072445 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:00.072801 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:00.072803 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:00.072920 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:00.073418 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:00.073427 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:00.075026 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:00.076874 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:00.076883 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:00.076885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:00.077211 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:00.077434 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:00.077436 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:00.077436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:00.077606 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:00.077897 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:00.077904 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:00.078083 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 18:53:00.078215 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 18:53:00.078403 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":106,"threads_started":1}
I20260811 18:53:00.079624 28957 heartbeater.cc:347] Connected to a master server at 127.23.226.254:33057
I20260811 18:53:00.079753 28957 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:00.079949 28957 heartbeater.cc:511] Master 127.23.226.254:33057 requested a full tablet report, sending...
I20260811 18:53:00.080437 28417 ts_manager.cc:194] Registered new tserver with Master: 1f4b244716734e8297050e262d660b1f (127.23.226.194:40019)
I20260811 18:53:00.080971 28417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:59415
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:53:00.106009 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33057
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:00.188953 28962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:00.189206 28962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:00.189246 28962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:00.190383 28962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:00.190472 28962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:00.190519 28962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:00.192098 28962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:00.192399 28962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:00.192641 28962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:00.197706 28973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:00.197773 28974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:00.197640 28976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:00.197949 28962 server_base.cc:1034] running on GCE node
I20260811 18:53:00.198199 28962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:00.198500 28962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:00.199756 28962 hybrid_clock.cc:648] HybridClock initialized: now 1786474380199732 us; error 37 us; skew 500 ppm
Aug 11 18:53:00 dist-test-slave-68xk krb5kdc[28345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474380, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:00.202798 28962 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:53:00.203286 28962 webserver.cc:460] Webserver started at http://127.23.226.195:46793/ using document root <none> and password file <none>
I20260811 18:53:00.203537 28962 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:00.203615 28962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:00.203764 28962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:00.204836 28962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "c6db4d83e45b4631931c993c83013fb7"
format_stamp: "Formatted at 2026-08-11 18:53:00 on dist-test-slave-68xk"
server_key: "277564f9ad9ca88ec87a946d2ace21ef"
server_key_iv: "8d3144c5ca2e61a01770afae10270e83"
server_key_version: "encryptionkey@0"
I20260811 18:53:00.205229 28962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "c6db4d83e45b4631931c993c83013fb7"
format_stamp: "Formatted at 2026-08-11 18:53:00 on dist-test-slave-68xk"
server_key: "277564f9ad9ca88ec87a946d2ace21ef"
server_key_iv: "8d3144c5ca2e61a01770afae10270e83"
server_key_version: "encryptionkey@0"
I20260811 18:53:00.206660 28962 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:00.207408 28987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:00.207602 28962 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:00.207715 28962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "c6db4d83e45b4631931c993c83013fb7"
format_stamp: "Formatted at 2026-08-11 18:53:00 on dist-test-slave-68xk"
server_key: "277564f9ad9ca88ec87a946d2ace21ef"
server_key_iv: "8d3144c5ca2e61a01770afae10270e83"
server_key_version: "encryptionkey@0"
I20260811 18:53:00.207788 28962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:00.221069 28962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:00.223037 28962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:00.223208 28962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:00.223443 28962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:00.223744 28962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:00.223783 28962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:00.223804 28962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:00.223817 28962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:00.229871 28962 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:40777
I20260811 18:53:00.229951 29170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:40777 every 8 connection(s)
I20260811 18:53:00.230283 28962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:00.231215 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 28962
I20260811 18:53:00.231307 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:00.231489 24459 external_mini_cluster.cc:1428] Setting key 0d5f4ed387b682a4e250be4700e40bc5
Aug 11 18:53:00 dist-test-slave-68xk krb5kdc[28345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474380, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:00.240154 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:00.231046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:34011 (local address 127.23.226.254:33057)
0811 18:53:00.231090 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:00.231092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:00.231347 (+ 255us) server_negotiation.cc:407] Connection header received
0811 18:53:00.232037 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:00.232039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:00.232052 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:00.232108 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:00.233109 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:00.233611 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:00.234691 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:00.234897 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:00.234974 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:00.237130 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:00.237132 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:00.237132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:00.237140 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:00.238667 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:00.239102 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:00.239104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:00.239104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:00.239183 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:00.239471 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:00.239472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:00.239472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:00.239589 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:00.239697 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:00.239980 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 18:53:00.240063 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 18:53:00.240351 29174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:00.231020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33057 (local address 127.23.226.195:34011)
0811 18:53:00.231208 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:00.231245 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:00.231928 (+ 683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:00.232180 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:00.232184 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:00.232816 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:00.233000 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:00.233004 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:00.233712 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:00.233713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:00.234582 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:00.234585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:00.234983 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:00.234984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:00.235124 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:00.235656 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:00.235669 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:00.237030 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:00.238768 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:00.238776 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:00.238778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:00.239011 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:00.239255 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:00.239256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:00.239256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:00.239370 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:00.239692 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:00.239700 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:00.239839 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 18:53:00.239945 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:53:00.240103 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260811 18:53:00.240856 29171 heartbeater.cc:347] Connected to a master server at 127.23.226.254:33057
I20260811 18:53:00.240958 29171 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:00.241153 29171 heartbeater.cc:511] Master 127.23.226.254:33057 requested a full tablet report, sending...
I20260811 18:53:00.241528 28417 ts_manager.cc:194] Registered new tserver with Master: c6db4d83e45b4631931c993c83013fb7 (127.23.226.195:40777)
I20260811 18:53:00.241921 28417 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:34011
I20260811 18:53:00.243126 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:53:00.256347 28516 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:00.255545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54362 (local address 127.23.226.254:33057)
0811 18:53:00.255612 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:00.255614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:00.255714 (+ 100us) server_negotiation.cc:407] Connection header received
0811 18:53:00.255758 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:00.255759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:00.255769 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:00.255827 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:00.256297 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54362: BlockingRecv error: recv got EOF from 127.0.0.1:54362 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:53:00.257364 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 28524
I20260811 18:53:00.275852 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 28738
I20260811 18:53:00.284864 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 28962
I20260811 18:53:00.295398 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 28367
2026-08-11T18:53:00Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2151 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:00 dist-test-slave-68xk krb5kdc[29190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:00 dist-test-slave-68xk krb5kdc[29190](info): set up 2 sockets
Aug 11 18:53:00 dist-test-slave-68xk krb5kdc[29190](info): commencing operation
krb5kdc: starting...
W20260811 18:53:01.584733 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:01 dist-test-slave-68xk krb5kdc[29190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:53:01.710609 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41023
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:41023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:01.798338 29211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:01.798610 29211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:01.798637 29211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:01.799976 29211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:01.800029 29211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:01.800045 29211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:01.800066 29211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:01.800081 29211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:01.801841 29211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:41023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:01.802135 29211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:01.802397 29211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:01.808061 29223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:01.808043 29218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:01.808064 29219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:01.808449 29211 server_base.cc:1034] running on GCE node
I20260811 18:53:01.808708 29211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:01.808976 29211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:01.810174 29211 hybrid_clock.cc:648] HybridClock initialized: now 1786474381810143 us; error 47 us; skew 500 ppm
Aug 11 18:53:01 dist-test-slave-68xk krb5kdc[29190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474381, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:01.813133 29211 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:53:01.813704 29211 webserver.cc:460] Webserver started at http://127.23.226.254:33595/ using document root <none> and password file <none>
I20260811 18:53:01.813961 29211 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:01.814041 29211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:01.814211 29211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:01.815472 29211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "de49cf9d7a7f4cd7951be121a8ae441c"
format_stamp: "Formatted at 2026-08-11 18:53:01 on dist-test-slave-68xk"
server_key: "1f19c13274d4b77c434ac52d76eb3297"
server_key_iv: "6e1be1cf3f92f02b63aeb61ccb1fe497"
server_key_version: "encryptionkey@0"
I20260811 18:53:01.815882 29211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "de49cf9d7a7f4cd7951be121a8ae441c"
format_stamp: "Formatted at 2026-08-11 18:53:01 on dist-test-slave-68xk"
server_key: "1f19c13274d4b77c434ac52d76eb3297"
server_key_iv: "6e1be1cf3f92f02b63aeb61ccb1fe497"
server_key_version: "encryptionkey@0"
I20260811 18:53:01.817414 29211 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:53:01.818215 29238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:01.818547 29211 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:01.818686 29211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "de49cf9d7a7f4cd7951be121a8ae441c"
format_stamp: "Formatted at 2026-08-11 18:53:01 on dist-test-slave-68xk"
server_key: "1f19c13274d4b77c434ac52d76eb3297"
server_key_iv: "6e1be1cf3f92f02b63aeb61ccb1fe497"
server_key_version: "encryptionkey@0"
I20260811 18:53:01.818773 29211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:01.826848 29211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:01.829125 29211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:01.829288 29211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:01.833606 29211 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:41023
I20260811 18:53:01.833732 29315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:41023 every 8 connection(s)
I20260811 18:53:01.834227 29211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:01.835005 29317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:01.835660 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 29211
I20260811 18:53:01.835760 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:01.835938 24459 external_mini_cluster.cc:1428] Setting key 3533eb185efe9d566960ef075cc118bd
I20260811 18:53:01.838707 29317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c: Bootstrap starting.
I20260811 18:53:01.839516 29317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:01.839870 29317 log.cc:824] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:01.840741 29317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c: No bootstrap required, opened a new log
I20260811 18:53:01.843075 29317 raft_consensus.cc:348] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49cf9d7a7f4cd7951be121a8ae441c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41023 } }
I20260811 18:53:01.843247 29317 raft_consensus.cc:374] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:01.843302 29317 raft_consensus.cc:729] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de49cf9d7a7f4cd7951be121a8ae441c, State: Initialized, Role: FOLLOWER
Aug 11 18:53:01 dist-test-slave-68xk krb5kdc[29190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:01.843441 29317 consensus_queue.cc:260] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49cf9d7a7f4cd7951be121a8ae441c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41023 } }
I20260811 18:53:01.843535 29317 raft_consensus.cc:388] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:01.843577 29317 raft_consensus.cc:482] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:01.843655 29317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:01.844312 29317 raft_consensus.cc:504] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49cf9d7a7f4cd7951be121a8ae441c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41023 } }
I20260811 18:53:01.844450 29317 leader_election.cc:302] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de49cf9d7a7f4cd7951be121a8ae441c; no voters:
I20260811 18:53:01.844666 29317 leader_election.cc:288] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:01.844733 29327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:01.844921 29327 raft_consensus.cc:686] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [term 1 LEADER]: Becoming Leader. State: Replica: de49cf9d7a7f4cd7951be121a8ae441c, State: Running, Role: LEADER
I20260811 18:53:01.844974 29317 sys_catalog.cc:564] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:01.845086 29327 consensus_queue.cc:237] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49cf9d7a7f4cd7951be121a8ae441c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41023 } }
I20260811 18:53:01.845489 29327 sys_catalog.cc:455] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [sys.catalog]: SysCatalogTable state changed. Reason: New leader de49cf9d7a7f4cd7951be121a8ae441c. Latest consensus state: current_term: 1 leader_uuid: "de49cf9d7a7f4cd7951be121a8ae441c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49cf9d7a7f4cd7951be121a8ae441c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41023 } } }
I20260811 18:53:01.845583 29330 sys_catalog.cc:455] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de49cf9d7a7f4cd7951be121a8ae441c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49cf9d7a7f4cd7951be121a8ae441c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41023 } } }
I20260811 18:53:01.845623 29327 sys_catalog.cc:458] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:01.845652 29330 sys_catalog.cc:458] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:01.845865 29338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:01.846473 29338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:01.848358 29322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:01.836509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51204 (local address 127.23.226.254:41023)
0811 18:53:01.836732 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:01.836743 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:01.836784 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:53:01.837419 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:01.837429 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:01.837496 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:01.837657 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:01.838319 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:01.839836 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:01.840630 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:01.841300 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:01.841422 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:01.843981 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:01.843984 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:01.843985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:01.843995 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:01.846481 (+ 2486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:01.847082 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:01.847086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:01.847086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:01.847210 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:01.847494 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:01.847495 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:01.847495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:01.847718 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:01.847816 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:01.847984 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 18:53:01.848087 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260811 18:53:01.849413 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:01.851593 29338 catalog_manager.cc:1347] Generated new cluster ID: 9941254ae1cb4a78b81feb0d338c0a70
I20260811 18:53:01.851658 29338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:01.861610 29338 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:01.862473 29338 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:01.866780 29338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de49cf9d7a7f4cd7951be121a8ae441c: Generated new TSK 0
I20260811 18:53:01.866968 29338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:01.869765 29322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:01.865198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51218 (local address 127.23.226.254:41023)
0811 18:53:01.865237 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:01.865240 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:01.865418 (+ 178us) server_negotiation.cc:407] Connection header received
0811 18:53:01.865477 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:01.865478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:01.865491 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:01.865563 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:01.865981 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:01.866889 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:01.867698 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:01.868067 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:01.868159 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:01.869200 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:01.869202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:01.869202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:01.869424 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:01.869445 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:01.869452 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:01.869526 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:01.869649 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 18:53:01.869687 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:53:01.872248 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 29211
2026-08-11T18:53:01Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1578 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:01 dist-test-slave-68xk krb5kdc[29367](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:01 dist-test-slave-68xk krb5kdc[29367](info): set up 2 sockets
Aug 11 18:53:01 dist-test-slave-68xk krb5kdc[29367](info): commencing operation
krb5kdc: starting...
W20260811 18:53:03.192608 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:03 dist-test-slave-68xk krb5kdc[29367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:53:03.317935 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:44895
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:44895
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:03.403501 29385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:03.403723 29385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:03.403745 29385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:03.404840 29385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:03.404881 29385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:03.404894 29385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:03.404907 29385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:03.404919 29385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:03.406352 29385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:44895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:44895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:03.406562 29385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:03.406745 29385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:03.411571 29393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:03.411566 29395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:03.411911 29397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:03.411885 29385 server_base.cc:1034] running on GCE node
I20260811 18:53:03.412159 29385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:03.412449 29385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:03.413635 29385 hybrid_clock.cc:648] HybridClock initialized: now 1786474383413617 us; error 49 us; skew 500 ppm
Aug 11 18:53:03 dist-test-slave-68xk krb5kdc[29367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474383, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:03.416356 29385 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:53:03.416857 29385 webserver.cc:460] Webserver started at http://127.23.226.254:46077/ using document root <none> and password file <none>
I20260811 18:53:03.417088 29385 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:03.417156 29385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:03.417313 29385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:03.418380 29385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "39d9c489666342f18aa9f13c3458d23e"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "63735c2de40183184a62790c59a2ee4d"
server_key_iv: "2649f56365ef683759492bcb2d22842a"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.418826 29385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "39d9c489666342f18aa9f13c3458d23e"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "63735c2de40183184a62790c59a2ee4d"
server_key_iv: "2649f56365ef683759492bcb2d22842a"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.420254 29385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:03.421020 29411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:03.421208 29385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:03.421310 29385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "39d9c489666342f18aa9f13c3458d23e"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "63735c2de40183184a62790c59a2ee4d"
server_key_iv: "2649f56365ef683759492bcb2d22842a"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.421389 29385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:03.439280 29385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:03.441504 29385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:03.441713 29385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:03.446156 29385 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:44895
I20260811 18:53:03.446197 29498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:44895 every 8 connection(s)
I20260811 18:53:03.446585 29385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:03.447692 29499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:03.450085 29499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e: Bootstrap starting.
I20260811 18:53:03.450798 29499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:03.451092 29499 log.cc:824] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:03.451876 29499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e: No bootstrap required, opened a new log
I20260811 18:53:03.453630 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 29385
I20260811 18:53:03.453523 29499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d9c489666342f18aa9f13c3458d23e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44895 } }
I20260811 18:53:03.453712 29499 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:03.453739 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:03.453753 29499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d9c489666342f18aa9f13c3458d23e, State: Initialized, Role: FOLLOWER
I20260811 18:53:03.453948 24459 external_mini_cluster.cc:1428] Setting key 49597607ce2ba932604853267388c467
I20260811 18:53:03.453918 29499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d9c489666342f18aa9f13c3458d23e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44895 } }
I20260811 18:53:03.453998 29499 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:03.454033 29499 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:03.454077 29499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:03.454875 29499 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d9c489666342f18aa9f13c3458d23e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44895 } }
I20260811 18:53:03.455003 29499 leader_election.cc:302] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39d9c489666342f18aa9f13c3458d23e; no voters:
I20260811 18:53:03.455178 29499 leader_election.cc:288] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:03.455206 29510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:03.455345 29510 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [term 1 LEADER]: Becoming Leader. State: Replica: 39d9c489666342f18aa9f13c3458d23e, State: Running, Role: LEADER
I20260811 18:53:03.455447 29499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:03.455502 29510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d9c489666342f18aa9f13c3458d23e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44895 } }
I20260811 18:53:03.455999 29511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39d9c489666342f18aa9f13c3458d23e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d9c489666342f18aa9f13c3458d23e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44895 } } }
I20260811 18:53:03.456084 29511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:03.456336 29512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39d9c489666342f18aa9f13c3458d23e. Latest consensus state: current_term: 1 leader_uuid: "39d9c489666342f18aa9f13c3458d23e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39d9c489666342f18aa9f13c3458d23e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44895 } } }
I20260811 18:53:03.456408 29512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:03.457121 29522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:03.457609 29522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:03.459363 29522 catalog_manager.cc:1347] Generated new cluster ID: 0a53b63f81df469dbe8acc10b1c5ab2f
I20260811 18:53:03.459421 29522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:53:03 dist-test-slave-68xk krb5kdc[29367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:03.466509 29509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:03.454542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43984 (local address 127.23.226.254:44895)
0811 18:53:03.455014 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:03.455024 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:03.455069 (+ 45us) server_negotiation.cc:407] Connection header received
0811 18:53:03.455229 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:03.455237 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:03.455302 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:03.456355 (+ 1053us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:03.456479 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.457903 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.458930 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.459561 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.459671 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:03.462487 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:03.462491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:03.462492 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:03.462505 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:03.464614 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:03.465025 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:03.465028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:03.465028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:03.465188 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:03.465409 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:03.465410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:03.465410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:03.465748 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:03.465922 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:03.466002 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 18:53:03.466271 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":384,"threads_started":1}
I20260811 18:53:03.474817 29522 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:03.475517 29522 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:03.491139 29522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39d9c489666342f18aa9f13c3458d23e: Generated new TSK 0
I20260811 18:53:03.491396 29522 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:53:03.525857 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44895
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:03.648573 29550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:03.648890 29550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:03.648927 29550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:03.651028 29550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:03.651085 29550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:03.651129 29550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:03.653100 29550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:03.653395 29550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:03.653652 29550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:03.659662 29567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:03.659663 29557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:03.659777 29559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:03.660028 29550 server_base.cc:1034] running on GCE node
I20260811 18:53:03.660310 29550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:03.660578 29550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:03.661747 29550 hybrid_clock.cc:648] HybridClock initialized: now 1786474383661729 us; error 36 us; skew 500 ppm
Aug 11 18:53:03 dist-test-slave-68xk krb5kdc[29367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474383, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:03.665055 29550 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:53:03.665555 29550 webserver.cc:460] Webserver started at http://127.23.226.193:40073/ using document root <none> and password file <none>
I20260811 18:53:03.665822 29550 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:03.665891 29550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:03.666030 29550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:03.667155 29550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "ee89bfde305040d99bf3ad9d560f06ba"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "1be867560c5fc12d145bad1c4cd64fcd"
server_key_iv: "58257775c56e19868ba3122c65e2ff64"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.667521 29550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "ee89bfde305040d99bf3ad9d560f06ba"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "1be867560c5fc12d145bad1c4cd64fcd"
server_key_iv: "58257775c56e19868ba3122c65e2ff64"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.668908 29550 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:03.669683 29579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:03.669863 29550 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:03.669967 29550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "ee89bfde305040d99bf3ad9d560f06ba"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "1be867560c5fc12d145bad1c4cd64fcd"
server_key_iv: "58257775c56e19868ba3122c65e2ff64"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.670049 29550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:03.693382 29550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:03.695592 29550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:03.695776 29550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:03.696038 29550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:03.696382 29550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:03.696440 29550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:03.696475 29550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:03.696504 29550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:03.703315 29550 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:41549
I20260811 18:53:03.703372 29771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:41549 every 8 connection(s)
I20260811 18:53:03.703696 29550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:53:03 dist-test-slave-68xk krb5kdc[29367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474383, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:03.713023 29509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:03.704488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:40065 (local address 127.23.226.254:44895)
0811 18:53:03.704555 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:03.704559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:03.704775 (+ 216us) server_negotiation.cc:407] Connection header received
0811 18:53:03.705341 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:03.705342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:03.705370 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:03.705420 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:03.706434 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.706944 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.707956 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.708166 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.708244 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:03.710376 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:03.710378 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:03.710378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:03.710385 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:03.711698 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:03.712165 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:03.712166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:03.712167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:03.712227 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:03.712462 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:03.712462 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:03.712463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:03.712568 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:03.712625 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:03.712873 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 18:53:03.712944 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:53:03.713068 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 29550
I20260811 18:53:03.713156 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:03.713260 29775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:03.704457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44895 (local address 127.23.226.193:40065)
0811 18:53:03.704647 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:03.704687 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:03.705229 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:03.705494 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:03.705498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:03.706094 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:03.706304 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:03.706310 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.707048 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.707049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:03.707859 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:03.707861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.708253 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.708254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:03.708385 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:03.708839 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:03.708848 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:03.710285 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:03.711777 (+ 1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:03.711784 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:03.711785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:03.712062 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:03.712294 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:03.712295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:03.712296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:03.712402 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:03.712625 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:03.712630 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:03.712745 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 18:53:03.712826 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 18:53:03.713008 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260811 18:53:03.713382 24459 external_mini_cluster.cc:1428] Setting key 31c24d7c2675eb073e71873666fc65e7
I20260811 18:53:03.713929 29772 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44895
I20260811 18:53:03.714061 29772 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:03.714277 29772 heartbeater.cc:511] Master 127.23.226.254:44895 requested a full tablet report, sending...
I20260811 18:53:03.714915 29436 ts_manager.cc:194] Registered new tserver with Master: ee89bfde305040d99bf3ad9d560f06ba (127.23.226.193:41549)
I20260811 18:53:03.715549 29436 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:40065
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:53:03.745555 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44895
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:03.830338 29778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:03.830616 29778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:03.830655 29778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:03.831796 29778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:03.831869 29778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:03.831914 29778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:03.833385 29778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:03.833662 29778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:03.833906 29778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:03.839089 29786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:03.839215 29785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:03.839078 29791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:03.839368 29778 server_base.cc:1034] running on GCE node
I20260811 18:53:03.839538 29778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:03.839733 29778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:03.840857 29778 hybrid_clock.cc:648] HybridClock initialized: now 1786474383840847 us; error 28 us; skew 500 ppm
Aug 11 18:53:03 dist-test-slave-68xk krb5kdc[29367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474383, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:03.843374 29778 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:53:03.843848 29778 webserver.cc:460] Webserver started at http://127.23.226.194:42607/ using document root <none> and password file <none>
I20260811 18:53:03.844080 29778 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:03.844148 29778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:03.844308 29778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:03.845402 29778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "598c6ff5bcf24513b1ca9286a9a52d0c"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "8a391f73b3bea7dd7aaca638f8531ece"
server_key_iv: "56bf394b82b116fa012163aab598be5a"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.845774 29778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "598c6ff5bcf24513b1ca9286a9a52d0c"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "8a391f73b3bea7dd7aaca638f8531ece"
server_key_iv: "56bf394b82b116fa012163aab598be5a"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.847234 29778 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:03.847946 29803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:03.848117 29778 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:03.848229 29778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "598c6ff5bcf24513b1ca9286a9a52d0c"
format_stamp: "Formatted at 2026-08-11 18:53:03 on dist-test-slave-68xk"
server_key: "8a391f73b3bea7dd7aaca638f8531ece"
server_key_iv: "56bf394b82b116fa012163aab598be5a"
server_key_version: "encryptionkey@0"
I20260811 18:53:03.848304 29778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:03.863797 29778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:03.866392 29778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:03.866667 29778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:03.866961 29778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:03.867350 29778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:03.867419 29778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:03.867457 29778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:03.867507 29778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:03.874464 29778 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:39475
I20260811 18:53:03.874509 29994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:39475 every 8 connection(s)
I20260811 18:53:03.874871 29778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:53:03 dist-test-slave-68xk krb5kdc[29367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474383, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:03.881562 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 29778
I20260811 18:53:03.881732 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:03.881946 24459 external_mini_cluster.cc:1428] Setting key a013355999948df750868c12d27934e4
I20260811 18:53:03.885699 29509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:03.875654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:53549 (local address 127.23.226.254:44895)
0811 18:53:03.875734 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:03.875737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:03.875915 (+ 178us) server_negotiation.cc:407] Connection header received
0811 18:53:03.876489 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:03.876491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:03.876503 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:03.876568 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:03.877569 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.878087 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.879195 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.879398 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.879480 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:03.882015 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:03.882017 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:03.882018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:03.882029 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:03.884016 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:03.884480 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:03.884481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:03.884482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:03.884556 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:03.884912 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:03.884913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:03.884913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:03.885057 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:03.885122 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:03.885552 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 18:53:03.885635 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:53:03.885957 29997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:03.875553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44895 (local address 127.23.226.194:53549)
0811 18:53:03.875782 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:03.875832 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:03.876373 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:03.876663 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:03.876673 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:03.877259 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:03.877461 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:03.877466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.878188 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.878190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:03.879101 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:03.879103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:03.879488 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:03.879489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:03.879625 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:03.880156 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:03.880166 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:03.881910 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:03.884112 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:03.884119 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:03.884160 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:03.884398 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:03.884633 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:03.884634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:03.884635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:03.884827 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:03.885176 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:03.885184 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:03.885370 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 18:53:03.885499 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 18:53:03.885686 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":94,"threads_started":1}
I20260811 18:53:03.886534 29995 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44895
I20260811 18:53:03.886649 29995 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:03.886832 29995 heartbeater.cc:511] Master 127.23.226.254:44895 requested a full tablet report, sending...
I20260811 18:53:03.887264 29436 ts_manager.cc:194] Registered new tserver with Master: 598c6ff5bcf24513b1ca9286a9a52d0c (127.23.226.194:39475)
I20260811 18:53:03.887655 29436 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:53549
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:53:03.910048 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44895
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:03.994971 30001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:03.995204 30001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:03.995246 30001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:03.996441 30001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:03.996661 30001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:03.996775 30001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:03.998713 30001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:03.999022 30001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:03.999301 30001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:04.004707 30020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:04.004707 30016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:04.004791 30018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:04.004844 30001 server_base.cc:1034] running on GCE node
I20260811 18:53:04.005153 30001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:04.005420 30001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:04.006597 30001 hybrid_clock.cc:648] HybridClock initialized: now 1786474384006573 us; error 42 us; skew 500 ppm
Aug 11 18:53:04 dist-test-slave-68xk krb5kdc[29367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474384, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:04.009198 30001 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:53:04.009594 30001 webserver.cc:460] Webserver started at http://127.23.226.195:35063/ using document root <none> and password file <none>
I20260811 18:53:04.009797 30001 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:04.009840 30001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:04.009928 30001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:04.010998 30001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "23eaaa7e11654a1e86481b0e8cdc3ac6"
format_stamp: "Formatted at 2026-08-11 18:53:04 on dist-test-slave-68xk"
server_key: "69c4dc8174f8db013e477a7a666c15fb"
server_key_iv: "cfb9d1acf264bb0525cd9a6fe648c39c"
server_key_version: "encryptionkey@0"
I20260811 18:53:04.011307 30001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "23eaaa7e11654a1e86481b0e8cdc3ac6"
format_stamp: "Formatted at 2026-08-11 18:53:04 on dist-test-slave-68xk"
server_key: "69c4dc8174f8db013e477a7a666c15fb"
server_key_iv: "cfb9d1acf264bb0525cd9a6fe648c39c"
server_key_version: "encryptionkey@0"
I20260811 18:53:04.012612 30001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:04.013307 30029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:04.013487 30001 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:04.013613 30001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "23eaaa7e11654a1e86481b0e8cdc3ac6"
format_stamp: "Formatted at 2026-08-11 18:53:04 on dist-test-slave-68xk"
server_key: "69c4dc8174f8db013e477a7a666c15fb"
server_key_iv: "cfb9d1acf264bb0525cd9a6fe648c39c"
server_key_version: "encryptionkey@0"
I20260811 18:53:04.013695 30001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:04.034272 30001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:04.036430 30001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:04.036602 30001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:04.036855 30001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:04.037194 30001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:04.037253 30001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:04.037300 30001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:04.037324 30001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:04.043498 30001 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:44483
I20260811 18:53:04.043550 30215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:44483 every 8 connection(s)
I20260811 18:53:04.043870 30001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:04.045733 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 30001
I20260811 18:53:04.045842 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:04.046051 24459 external_mini_cluster.cc:1428] Setting key 43eef6ab5ed2f12b146d50504c463fd1
Aug 11 18:53:04 dist-test-slave-68xk krb5kdc[29367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474384, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:04.054033 29509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:04.044617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:55921 (local address 127.23.226.254:44895)
0811 18:53:04.044706 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:04.044709 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:04.044900 (+ 191us) server_negotiation.cc:407] Connection header received
0811 18:53:04.045433 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:04.045435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:04.045448 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:04.045517 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:04.046865 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:04.047494 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:04.048479 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:04.048702 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:04.048772 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:04.051150 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:04.051152 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:04.051152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:04.051159 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:04.052561 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:04.052991 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:04.052992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:04.052992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:04.053058 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:04.053382 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:04.053384 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:04.053384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:04.053516 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:04.053602 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:04.053878 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 18:53:04.053964 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:53:04.054279 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:04.044583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44895 (local address 127.23.226.195:55921)
0811 18:53:04.044780 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:04.044817 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:04.045312 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:04.045646 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:04.045651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:04.046466 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:04.046766 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:04.046773 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:04.047578 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:04.047579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:04.048390 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:04.048393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:04.048787 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:04.048788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:04.048895 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:04.049445 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:04.049453 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:04.051032 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:04.052666 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:04.052673 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:04.052675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:04.052894 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:04.053177 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:04.053178 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:04.053178 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:04.053283 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:04.053610 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:04.053617 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:04.053740 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 18:53:04.053833 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:53:04.053956 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":113,"threads_started":1}
I20260811 18:53:04.054952 30217 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44895
I20260811 18:53:04.055064 30217 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:04.055249 30217 heartbeater.cc:511] Master 127.23.226.254:44895 requested a full tablet report, sending...
I20260811 18:53:04.055845 29436 ts_manager.cc:194] Registered new tserver with Master: 23eaaa7e11654a1e86481b0e8cdc3ac6 (127.23.226.195:44483)
I20260811 18:53:04.056341 29436 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:55921
I20260811 18:53:04.058034 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:53:04 dist-test-slave-68xk krb5kdc[29367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474384, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 18:53:04 dist-test-slave-68xk krb5kdc[29367](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474384, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:04.083346 29509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:04.075902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43988 (local address 127.23.226.254:44895)
0811 18:53:04.075974 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:04.075976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:04.076132 (+ 156us) server_negotiation.cc:407] Connection header received
0811 18:53:04.076264 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:04.076265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:04.076275 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:04.076342 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:04.076955 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:04.077450 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:04.078204 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:04.078478 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:04.078563 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:04.080821 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:04.080823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:04.080823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:04.080831 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:04.082090 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:04.082463 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:04.082464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:04.082465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:04.082529 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:04.082749 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:04.082750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:04.082750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:04.082911 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:04.083023 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:04.083145 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 18:53:04.083238 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 18:53:04.083614 29436 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:43988
I20260811 18:53:04.084087 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 29550
I20260811 18:53:04.103379 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 29778
I20260811 18:53:04.113801 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 30001
I20260811 18:53:04.128540 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 29385
2026-08-11T18:53:04Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2252 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:04 dist-test-slave-68xk krb5kdc[30235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:04 dist-test-slave-68xk krb5kdc[30235](info): set up 2 sockets
Aug 11 18:53:04 dist-test-slave-68xk krb5kdc[30235](info): commencing operation
krb5kdc: starting...
W20260811 18:53:05.375708 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:05 dist-test-slave-68xk krb5kdc[30235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:53:05.510510 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:43423
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:36905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:43423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:05.597210 30256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:05.597425 30256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:05.597448 30256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:05.598660 30256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:05.598706 30256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:05.598721 30256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:05.598733 30256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:05.598745 30256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:05.600293 30256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:43423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:43423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:05.600564 30256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:05.600803 30256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:05.605995 30263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:05.606171 30270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:05.606216 30267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:05.606485 30256 server_base.cc:1034] running on GCE node
I20260811 18:53:05.606786 30256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:05.607048 30256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:05.608247 30256 hybrid_clock.cc:648] HybridClock initialized: now 1786474385608231 us; error 31 us; skew 500 ppm
Aug 11 18:53:05 dist-test-slave-68xk krb5kdc[30235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474385, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:05.616256 30256 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:53:05.616763 30256 webserver.cc:460] Webserver started at http://127.23.226.254:35497/ using document root <none> and password file <none>
I20260811 18:53:05.617038 30256 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:05.617120 30256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:05.617276 30256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:05.618543 30256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "bec07d7515ea4830bb841fe4cbcb6c7a"
format_stamp: "Formatted at 2026-08-11 18:53:05 on dist-test-slave-68xk"
server_key: "ad240c378fed03a91010be1829ec11c8"
server_key_iv: "005aa2d8f202190c34b1a082513dc169"
server_key_version: "encryptionkey@0"
I20260811 18:53:05.618948 30256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "bec07d7515ea4830bb841fe4cbcb6c7a"
format_stamp: "Formatted at 2026-08-11 18:53:05 on dist-test-slave-68xk"
server_key: "ad240c378fed03a91010be1829ec11c8"
server_key_iv: "005aa2d8f202190c34b1a082513dc169"
server_key_version: "encryptionkey@0"
I20260811 18:53:05.620464 30256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:53:05.621327 30282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:05.621548 30256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:05.621682 30256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "bec07d7515ea4830bb841fe4cbcb6c7a"
format_stamp: "Formatted at 2026-08-11 18:53:05 on dist-test-slave-68xk"
server_key: "ad240c378fed03a91010be1829ec11c8"
server_key_iv: "005aa2d8f202190c34b1a082513dc169"
server_key_version: "encryptionkey@0"
I20260811 18:53:05.621762 30256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:05.649960 30256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:05.652601 30256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:05.652783 30256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:05.657248 30256 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:43423
I20260811 18:53:05.657326 30368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:43423 every 8 connection(s)
I20260811 18:53:05.657855 30256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:05.658720 30370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:05.661026 30370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a: Bootstrap starting.
I20260811 18:53:05.661593 30370 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:05.661877 30370 log.cc:824] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:05.662621 30370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a: No bootstrap required, opened a new log
I20260811 18:53:05.664163 30370 raft_consensus.cc:348] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec07d7515ea4830bb841fe4cbcb6c7a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43423 } }
I20260811 18:53:05.664337 30370 raft_consensus.cc:374] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:05.664362 30370 raft_consensus.cc:729] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bec07d7515ea4830bb841fe4cbcb6c7a, State: Initialized, Role: FOLLOWER
I20260811 18:53:05.664501 30370 consensus_queue.cc:260] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec07d7515ea4830bb841fe4cbcb6c7a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43423 } }
I20260811 18:53:05.664585 30370 raft_consensus.cc:388] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:05.664608 30370 raft_consensus.cc:482] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:05.664637 30370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:05.665548 30370 raft_consensus.cc:504] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec07d7515ea4830bb841fe4cbcb6c7a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43423 } }
I20260811 18:53:05.665637 30370 leader_election.cc:302] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bec07d7515ea4830bb841fe4cbcb6c7a; no voters:
I20260811 18:53:05.665791 30370 leader_election.cc:288] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:05.665827 30376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:05.665962 30376 raft_consensus.cc:686] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [term 1 LEADER]: Becoming Leader. State: Replica: bec07d7515ea4830bb841fe4cbcb6c7a, State: Running, Role: LEADER
I20260811 18:53:05.666062 30370 sys_catalog.cc:564] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:05.666116 30376 consensus_queue.cc:237] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec07d7515ea4830bb841fe4cbcb6c7a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43423 } }
I20260811 18:53:05.666600 30378 sys_catalog.cc:455] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bec07d7515ea4830bb841fe4cbcb6c7a. Latest consensus state: current_term: 1 leader_uuid: "bec07d7515ea4830bb841fe4cbcb6c7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec07d7515ea4830bb841fe4cbcb6c7a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43423 } } }
I20260811 18:53:05.666808 30378 sys_catalog.cc:458] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:05.666841 30377 sys_catalog.cc:455] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bec07d7515ea4830bb841fe4cbcb6c7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec07d7515ea4830bb841fe4cbcb6c7a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43423 } } }
I20260811 18:53:05.666977 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 30256
I20260811 18:53:05.667006 30377 sys_catalog.cc:458] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:05.667084 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:05.667135 30394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:05.667271 24459 external_mini_cluster.cc:1428] Setting key 870e261da5c729833a3a943203c63be2
I20260811 18:53:05.667708 30394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:05.669554 30394 catalog_manager.cc:1347] Generated new cluster ID: 14722b8cac8e44218b18e84495e506cb
I20260811 18:53:05.669605 30394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:53:05 dist-test-slave-68xk krb5kdc[30235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:05.680044 30411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:05.667734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42372 (local address 127.23.226.254:43423)
0811 18:53:05.667921 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:05.667932 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:05.667966 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:53:05.668090 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:05.668098 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:05.668157 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:05.668289 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:05.669029 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:05.670394 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:05.671521 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:05.672171 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:05.672298 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:05.675314 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:05.675319 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:05.675319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:05.675331 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:05.677943 (+ 2612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:05.678358 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:05.678361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:05.678361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:05.678495 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:05.678717 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:05.678718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:05.678718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:05.679053 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:05.679216 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:05.679669 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 18:53:05.679812 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":61,"threads_started":1}
I20260811 18:53:05.685942 30394 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:05.686553 30394 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:05.699533 30394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bec07d7515ea4830bb841fe4cbcb6c7a: Generated new TSK 0
I20260811 18:53:05.699750 30394 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:53:05.733865 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43423
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:36905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:05.829022 30423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:05.829259 30423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:05.829285 30423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:05.830391 30423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:05.830444 30423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:05.830471 30423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:05.832008 30423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:05.832284 30423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:05.832535 30423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:05.838167 30432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:05.838302 30423 server_base.cc:1034] running on GCE node
W20260811 18:53:05.838232 30435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:05.838191 30430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:05.838665 30423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:05.838893 30423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:05.840066 30423 hybrid_clock.cc:648] HybridClock initialized: now 1786474385840046 us; error 40 us; skew 500 ppm
Aug 11 18:53:05 dist-test-slave-68xk krb5kdc[30235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474385, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:05.842695 30423 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:53:05.843211 30423 webserver.cc:460] Webserver started at http://127.23.226.193:44085/ using document root <none> and password file <none>
I20260811 18:53:05.843425 30423 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:05.843467 30423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:05.843561 30423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:05.844563 30423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "0864f0c12da24febb76fe2ee735fe93b"
format_stamp: "Formatted at 2026-08-11 18:53:05 on dist-test-slave-68xk"
server_key: "486ee73a7c7a86e0333cb9c4955dedc6"
server_key_iv: "5dbaf80aa817da6f491901d52aa0f2fc"
server_key_version: "encryptionkey@0"
I20260811 18:53:05.844873 30423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "0864f0c12da24febb76fe2ee735fe93b"
format_stamp: "Formatted at 2026-08-11 18:53:05 on dist-test-slave-68xk"
server_key: "486ee73a7c7a86e0333cb9c4955dedc6"
server_key_iv: "5dbaf80aa817da6f491901d52aa0f2fc"
server_key_version: "encryptionkey@0"
I20260811 18:53:05.846263 30423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:53:05.847040 30445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:05.847271 30423 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:05.847368 30423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "0864f0c12da24febb76fe2ee735fe93b"
format_stamp: "Formatted at 2026-08-11 18:53:05 on dist-test-slave-68xk"
server_key: "486ee73a7c7a86e0333cb9c4955dedc6"
server_key_iv: "5dbaf80aa817da6f491901d52aa0f2fc"
server_key_version: "encryptionkey@0"
I20260811 18:53:05.847446 30423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:05.855809 30423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:05.857931 30423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:05.858098 30423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:05.858355 30423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:05.858700 30423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:05.858736 30423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:05.858758 30423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:05.858771 30423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:05.865227 30423 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:45339
I20260811 18:53:05.865303 30646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:45339 every 8 connection(s)
I20260811 18:53:05.865612 30423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:05.871145 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 30423
I20260811 18:53:05.871261 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:05.871474 24459 external_mini_cluster.cc:1428] Setting key 6244cd105650acca191693eebf77c7ec
Aug 11 18:53:05 dist-test-slave-68xk krb5kdc[30235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474385, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:05.875536 30411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:05.866369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:34879 (local address 127.23.226.254:43423)
0811 18:53:05.866439 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:05.866442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:05.866672 (+ 230us) server_negotiation.cc:407] Connection header received
0811 18:53:05.867775 (+ 1103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:05.867777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:05.867791 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:05.867846 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:05.868445 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:05.868947 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:05.869961 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:05.870148 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:05.870198 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:05.872588 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:05.872590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:05.872590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:05.872598 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:05.874064 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:05.874529 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:05.874531 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:05.874531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:05.874596 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:05.874873 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:05.874874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:05.874874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:05.874991 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:05.875070 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:05.875400 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 18:53:05.875472 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:53:05.875808 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:05.866344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43423 (local address 127.23.226.193:34879)
0811 18:53:05.866541 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:05.866578 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:05.867649 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:05.867902 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:05.867906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:05.868172 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:05.868368 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:05.868372 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:05.869032 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:05.869032 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:05.869887 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:05.869889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:05.870229 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:05.870230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:05.870340 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:05.870885 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:05.870894 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:05.872481 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:05.874170 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:05.874178 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:05.874180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:05.874465 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:05.874666 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:05.874667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:05.874667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:05.874793 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:05.875061 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:05.875069 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:05.875237 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 18:53:05.875343 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:53:05.875521 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":131,"threads_started":1}
I20260811 18:53:05.876411 30647 heartbeater.cc:347] Connected to a master server at 127.23.226.254:43423
I20260811 18:53:05.876506 30647 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:05.876708 30647 heartbeater.cc:511] Master 127.23.226.254:43423 requested a full tablet report, sending...
I20260811 18:53:05.877245 30308 ts_manager.cc:194] Registered new tserver with Master: 0864f0c12da24febb76fe2ee735fe93b (127.23.226.193:45339)
I20260811 18:53:05.877810 30308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:34879
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:53:05.902216 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43423
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:36905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:05.989675 30653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:05.989874 30653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:05.989897 30653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:05.991019 30653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:05.991057 30653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:05.991132 30653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:05.992594 30653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:05.992774 30653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:05.992945 30653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:05.998075 30660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:05.998097 30661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:05.998116 30666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:05.998392 30653 server_base.cc:1034] running on GCE node
I20260811 18:53:05.998621 30653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:05.998896 30653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:06.000052 30653 hybrid_clock.cc:648] HybridClock initialized: now 1786474386000039 us; error 29 us; skew 500 ppm
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[30235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474385, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:06.002965 30653 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:53:06.003474 30653 webserver.cc:460] Webserver started at http://127.23.226.194:43099/ using document root <none> and password file <none>
I20260811 18:53:06.003702 30653 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:06.003748 30653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:06.003890 30653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:06.005016 30653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "daaa3ffa3c0f41d0abacb6b8481dde24"
format_stamp: "Formatted at 2026-08-11 18:53:06 on dist-test-slave-68xk"
server_key: "17b566511bf4c2919a041099655ef9c6"
server_key_iv: "eaef969a85b80ee56e0a8730327dc8e9"
server_key_version: "encryptionkey@0"
I20260811 18:53:06.005400 30653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "daaa3ffa3c0f41d0abacb6b8481dde24"
format_stamp: "Formatted at 2026-08-11 18:53:06 on dist-test-slave-68xk"
server_key: "17b566511bf4c2919a041099655ef9c6"
server_key_iv: "eaef969a85b80ee56e0a8730327dc8e9"
server_key_version: "encryptionkey@0"
I20260811 18:53:06.007037 30653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:06.007848 30686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:06.008028 30653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:06.008121 30653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "daaa3ffa3c0f41d0abacb6b8481dde24"
format_stamp: "Formatted at 2026-08-11 18:53:06 on dist-test-slave-68xk"
server_key: "17b566511bf4c2919a041099655ef9c6"
server_key_iv: "eaef969a85b80ee56e0a8730327dc8e9"
server_key_version: "encryptionkey@0"
I20260811 18:53:06.008181 30653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:06.022374 30653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:06.024634 30653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:06.024760 30653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:06.024962 30653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:06.025259 30653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:06.025295 30653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:06.025317 30653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:06.025332 30653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:06.032001 30653 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:36003
I20260811 18:53:06.032083 30870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:36003 every 8 connection(s)
I20260811 18:53:06.032445 30653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:06.038273 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 30653
I20260811 18:53:06.038385 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:06.038604 24459 external_mini_cluster.cc:1428] Setting key 3d9f4c7b31dee8bbb02e3ab34f74d3ec
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[30235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474385, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:06.043313 30411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:06.033288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:57983 (local address 127.23.226.254:43423)
0811 18:53:06.033374 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:06.033376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:06.033671 (+ 295us) server_negotiation.cc:407] Connection header received
0811 18:53:06.034769 (+ 1098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:06.034771 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:06.034782 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:06.034844 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:06.035498 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.036039 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.037185 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.037387 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.037453 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:06.040230 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:06.040232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:06.040232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:06.040242 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:06.041781 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:06.042273 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:06.042274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:06.042275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:06.042340 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:06.042638 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:06.042639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:06.042639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:06.042756 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:06.042829 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:06.043121 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 18:53:06.043223 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 18:53:06.043489 30874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:06.033302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43423 (local address 127.23.226.194:57983)
0811 18:53:06.033515 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:06.033561 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:06.034669 (+ 1108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:06.034897 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:06.034900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:06.035174 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:06.035367 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:06.035371 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.036154 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.036156 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:06.037072 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:06.037074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.037479 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.037480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:06.037610 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:06.038288 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:06.038298 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:06.040122 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:06.041928 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:06.041935 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:06.041938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:06.042187 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:06.042438 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:06.042439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:06.042439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:06.042550 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:06.042832 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:06.042841 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:06.042977 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 18:53:06.043077 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:53:06.043245 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":106,"threads_started":1}
I20260811 18:53:06.044113 30871 heartbeater.cc:347] Connected to a master server at 127.23.226.254:43423
I20260811 18:53:06.044246 30871 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:06.044478 30871 heartbeater.cc:511] Master 127.23.226.254:43423 requested a full tablet report, sending...
I20260811 18:53:06.044973 30308 ts_manager.cc:194] Registered new tserver with Master: daaa3ffa3c0f41d0abacb6b8481dde24 (127.23.226.194:36003)
I20260811 18:53:06.045385 30308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:57983
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:53:06.070204 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43423
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:36905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:06.155112 30884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:06.155318 30884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:06.155341 30884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:06.156515 30884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:06.156562 30884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:06.156589 30884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:06.158121 30884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:06.158373 30884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:06.158651 30884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:06.164043 30893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:06.164005 30896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:06.164062 30884 server_base.cc:1034] running on GCE node
W20260811 18:53:06.164021 30900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:06.164455 30884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:06.164733 30884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:06.165911 30884 hybrid_clock.cc:648] HybridClock initialized: now 1786474386165888 us; error 79 us; skew 500 ppm
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[30235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474386, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:06.169134 30884 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:53:06.169584 30884 webserver.cc:460] Webserver started at http://127.23.226.195:38201/ using document root <none> and password file <none>
I20260811 18:53:06.169816 30884 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:06.169862 30884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:06.169970 30884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:06.171180 30884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "c06008e5472c4789801be01676cf18be"
format_stamp: "Formatted at 2026-08-11 18:53:06 on dist-test-slave-68xk"
server_key: "38ce983a896fd055e1fb8707388da31b"
server_key_iv: "824ffb800e9ff1aee6af0612ea66b3a1"
server_key_version: "encryptionkey@0"
I20260811 18:53:06.171509 30884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "c06008e5472c4789801be01676cf18be"
format_stamp: "Formatted at 2026-08-11 18:53:06 on dist-test-slave-68xk"
server_key: "38ce983a896fd055e1fb8707388da31b"
server_key_iv: "824ffb800e9ff1aee6af0612ea66b3a1"
server_key_version: "encryptionkey@0"
I20260811 18:53:06.172940 30884 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:06.173785 30911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:06.174013 30884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:06.174115 30884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "c06008e5472c4789801be01676cf18be"
format_stamp: "Formatted at 2026-08-11 18:53:06 on dist-test-slave-68xk"
server_key: "38ce983a896fd055e1fb8707388da31b"
server_key_iv: "824ffb800e9ff1aee6af0612ea66b3a1"
server_key_version: "encryptionkey@0"
I20260811 18:53:06.174172 30884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:06.182206 30884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:06.184494 30884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:06.184612 30884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:06.184806 30884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:06.185150 30884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:06.185186 30884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:06.185209 30884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:06.185262 30884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:06.191169 30884 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:37845
I20260811 18:53:06.191272 31099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:37845 every 8 connection(s)
I20260811 18:53:06.191577 30884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:06.195549 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 30884
I20260811 18:53:06.195627 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:06.195812 24459 external_mini_cluster.cc:1428] Setting key 12e4b210a345fa7fcbd1ad2d12a78931
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[30235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474386, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:06.201862 30411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:06.192369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:33169 (local address 127.23.226.254:43423)
0811 18:53:06.192453 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:06.192456 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:06.192652 (+ 196us) server_negotiation.cc:407] Connection header received
0811 18:53:06.193590 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:06.193592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:06.193615 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:06.193674 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:06.194310 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.194949 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.196114 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.196425 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.196501 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:06.198784 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:06.198786 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:06.198786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:06.198793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:06.200464 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:06.200838 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:06.200839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:06.200839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:06.200892 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:06.201282 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:06.201283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:06.201283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:06.201402 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:06.201472 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:06.201730 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 18:53:06.201799 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:53:06.202080 31105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:06.192326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43423 (local address 127.23.226.195:33169)
0811 18:53:06.192527 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:06.192564 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:06.193485 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:06.193745 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:06.193748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:06.194001 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:06.194192 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:06.194196 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.195032 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.195033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:06.196019 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:06.196022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.196519 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.196520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:06.196645 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:06.197168 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:06.197177 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:06.198693 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:06.200538 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:06.200545 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:06.200547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:06.200769 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:06.200951 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:06.200952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:06.200952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:06.201053 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:06.201479 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:06.201485 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:06.201604 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 18:53:06.201694 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 18:53:06.201824 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":117,"threads_started":1}
I20260811 18:53:06.202653 31102 heartbeater.cc:347] Connected to a master server at 127.23.226.254:43423
I20260811 18:53:06.202764 31102 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:06.202942 31102 heartbeater.cc:511] Master 127.23.226.254:43423 requested a full tablet report, sending...
I20260811 18:53:06.203415 30308 ts_manager.cc:194] Registered new tserver with Master: c06008e5472c4789801be01676cf18be (127.23.226.195:37845)
I20260811 18:53:06.203934 30308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:33169
I20260811 18:53:06.208005 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[30235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[30235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:53:06.235797 31112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:06.226778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52240 (local address 127.23.226.193:45339)
0811 18:53:06.226985 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:06.226991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:06.227003 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:53:06.227033 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:06.227036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:06.227051 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:06.227129 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:06.227744 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.228577 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.229548 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.229902 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.229972 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:06.232501 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:06.232510 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:06.232511 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:06.232519 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:06.234470 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:06.234835 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:06.234839 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:06.234839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:06.234919 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:06.235211 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:06.235212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:06.235213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:06.235367 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:06.235487 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:06.235599 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 18:53:06.235668 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":110,"threads_started":1}
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[30235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:06.244844 30411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:06.237298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.23.226.254:43423)
0811 18:53:06.237360 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:06.237362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:06.237373 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:06.237439 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:06.237440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:06.237455 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:06.237516 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:06.238015 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.238563 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.239266 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:06.239456 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:06.239539 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:06.241959 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:06.241961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:06.241961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:06.241970 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:06.243537 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:06.244133 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:06.244134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:06.244134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:06.244194 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:06.244374 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:06.244375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:06.244375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:06.244515 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:06.244594 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:06.244682 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 18:53:06.244746 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 18:53:06.245154 30308 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42384
I20260811 18:53:06.245565 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 30423
I20260811 18:53:06.256551 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 30653
I20260811 18:53:06.276573 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 30884
I20260811 18:53:06.284619 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 30256
2026-08-11T18:53:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2161 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[31121](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[31121](info): set up 2 sockets
Aug 11 18:53:06 dist-test-slave-68xk krb5kdc[31121](info): commencing operation
krb5kdc: starting...
W20260811 18:53:07.567749 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:07 dist-test-slave-68xk krb5kdc[31121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:53:07.694329 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41483
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:41483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:07.780241 31142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:07.780454 31142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:07.780478 31142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:07.781661 31142 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:07.781714 31142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:07.781728 31142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:07.781741 31142 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:07.781754 31142 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:07.783452 31142 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:41483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:07.783735 31142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:07.784003 31142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:07.789341 31151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:07.789336 31155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:07.789379 31142 server_base.cc:1034] running on GCE node
W20260811 18:53:07.790197 31152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:07.790580 31142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:07.790951 31142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:07.792111 31142 hybrid_clock.cc:648] HybridClock initialized: now 1786474387792088 us; error 44 us; skew 500 ppm
Aug 11 18:53:07 dist-test-slave-68xk krb5kdc[31121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474387, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:07.794947 31142 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:53:07.795276 31142 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:07.795324 31142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:07.795419 31142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:07.796505 31142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "deaeb07db50c4739a8bd7bc97f156734"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-68xk"
server_key: "49c2e99939a3575ec888c725dc21fa4f"
server_key_iv: "23107e8424da29f1aefe639ea76cb619"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.796829 31142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "deaeb07db50c4739a8bd7bc97f156734"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-68xk"
server_key: "49c2e99939a3575ec888c725dc21fa4f"
server_key_iv: "23107e8424da29f1aefe639ea76cb619"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.798110 31142 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:07.798956 31165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:07.799139 31142 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:07.799237 31142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "deaeb07db50c4739a8bd7bc97f156734"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-68xk"
server_key: "49c2e99939a3575ec888c725dc21fa4f"
server_key_iv: "23107e8424da29f1aefe639ea76cb619"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.799301 31142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:07.811175 31142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:07.813325 31142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:07.813441 31142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:07.817549 31142 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:41483
I20260811 18:53:07.817600 31253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:41483 every 8 connection(s)
I20260811 18:53:07.817922 31142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:07.819094 31256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:07.820163 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 31142
I20260811 18:53:07.820291 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:07.820466 24459 external_mini_cluster.cc:1428] Setting key 63e8c3b313897d74e2a2ed0ff60bd065
I20260811 18:53:07.822335 31256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734: Bootstrap starting.
I20260811 18:53:07.823148 31256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:07.823527 31256 log.cc:824] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:07.824374 31256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734: No bootstrap required, opened a new log
I20260811 18:53:07.826979 31256 raft_consensus.cc:348] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeb07db50c4739a8bd7bc97f156734" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41483 } }
I20260811 18:53:07.827126 31256 raft_consensus.cc:374] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:07.827149 31256 raft_consensus.cc:729] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deaeb07db50c4739a8bd7bc97f156734, State: Initialized, Role: FOLLOWER
I20260811 18:53:07.827298 31256 consensus_queue.cc:260] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeb07db50c4739a8bd7bc97f156734" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41483 } }
I20260811 18:53:07.827387 31256 raft_consensus.cc:388] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:07.827458 31256 raft_consensus.cc:482] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:07.827513 31256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:07.828190 31256 raft_consensus.cc:504] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeb07db50c4739a8bd7bc97f156734" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41483 } }
I20260811 18:53:07.828315 31256 leader_election.cc:302] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: deaeb07db50c4739a8bd7bc97f156734; no voters:
I20260811 18:53:07.828500 31256 leader_election.cc:288] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:07.828629 31263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 1 FOLLOWER]: Leader election won for term 1
Aug 11 18:53:07 dist-test-slave-68xk krb5kdc[31121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:07.828775 31263 raft_consensus.cc:686] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [term 1 LEADER]: Becoming Leader. State: Replica: deaeb07db50c4739a8bd7bc97f156734, State: Running, Role: LEADER
I20260811 18:53:07.828869 31263 consensus_queue.cc:237] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeb07db50c4739a8bd7bc97f156734" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41483 } }
I20260811 18:53:07.828914 31256 sys_catalog.cc:564] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:07.829166 31267 sys_catalog.cc:455] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "deaeb07db50c4739a8bd7bc97f156734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeb07db50c4739a8bd7bc97f156734" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41483 } } }
I20260811 18:53:07.829246 31267 sys_catalog.cc:458] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:07.829154 31263 sys_catalog.cc:455] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deaeb07db50c4739a8bd7bc97f156734. Latest consensus state: current_term: 1 leader_uuid: "deaeb07db50c4739a8bd7bc97f156734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeb07db50c4739a8bd7bc97f156734" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41483 } } }
I20260811 18:53:07.829414 31263 sys_catalog.cc:458] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:07.830117 31269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:07.830737 31269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:07.832890 31269 catalog_manager.cc:1347] Generated new cluster ID: 414644746c2d45068c80eb4ec27015c2
I20260811 18:53:07.832948 31269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:07.833911 31260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:07.821218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43304 (local address 127.23.226.254:41483)
0811 18:53:07.821449 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:07.821472 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:07.821511 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:53:07.822095 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:07.822105 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:07.822172 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:07.822356 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:07.823099 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:07.824610 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:07.825405 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:07.826119 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:07.826301 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:07.829572 (+ 3271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:07.829576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:07.829577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:07.829593 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:07.831985 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:07.832474 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:07.832478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:07.832479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:07.832580 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:07.832835 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:07.832836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:07.832836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:07.833173 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:07.833327 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:07.833530 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 18:53:07.833679 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":94,"threads_started":1}
I20260811 18:53:07.843335 31269 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:07.844065 31269 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:07.850592 31269 catalog_manager.cc:5868] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734: Generated new TSK 0
I20260811 18:53:07.850783 31269 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:53:07.882076 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41483
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:07.967621 31298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:07.967836 31298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:07.967859 31298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:07.969017 31298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:07.969058 31298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:07.969085 31298 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:07.970708 31298 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:07.970964 31298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:07.971195 31298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:07.976402 31314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:07.976475 31298 server_base.cc:1034] running on GCE node
W20260811 18:53:07.976410 31307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:07.976424 31308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:07.976892 31298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:07.977193 31298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:07.978360 31298 hybrid_clock.cc:648] HybridClock initialized: now 1786474387978359 us; error 43 us; skew 500 ppm
Aug 11 18:53:07 dist-test-slave-68xk krb5kdc[31121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474387, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:07.980950 31298 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:53:07.981336 31298 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:07.981413 31298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:07.981580 31298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:07.982717 31298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-68xk"
server_key: "5af077ba3cf6eba3cdf6139404804e59"
server_key_iv: "a6d91d06f33ec612d48215ddf687ed38"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.983075 31298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-68xk"
server_key: "5af077ba3cf6eba3cdf6139404804e59"
server_key_iv: "a6d91d06f33ec612d48215ddf687ed38"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.984702 31298 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:07.985733 31328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:07.986007 31298 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:07.986128 31298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6"
format_stamp: "Formatted at 2026-08-11 18:53:07 on dist-test-slave-68xk"
server_key: "5af077ba3cf6eba3cdf6139404804e59"
server_key_iv: "a6d91d06f33ec612d48215ddf687ed38"
server_key_version: "encryptionkey@0"
I20260811 18:53:07.986195 31298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:07.995477 31298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:07.997571 31298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:07.997749 31298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:07.997991 31298 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:07.998337 31298 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:07.998396 31298 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:07.998448 31298 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:07.998477 31298 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:08.005368 31298 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:45091
I20260811 18:53:08.005415 31511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:45091 every 8 connection(s)
I20260811 18:53:08.005702 31298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:08.008425 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 31298
I20260811 18:53:08.008574 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:08.008790 24459 external_mini_cluster.cc:1428] Setting key 70da5d9016dcc189e7dc39be2eaa6473
Aug 11 18:53:08 dist-test-slave-68xk krb5kdc[31121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474387, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:08.016779 31260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.006654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:36887 (local address 127.23.226.254:41483)
0811 18:53:08.006737 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.006739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.006850 (+ 111us) server_negotiation.cc:407] Connection header received
0811 18:53:08.007408 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.007409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.007422 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.007489 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:08.008497 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.009213 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.010328 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.010662 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.010750 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.013457 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:08.013458 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:08.013458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:08.013466 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:08.015065 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:08.015644 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:08.015645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:08.015645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:08.015716 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:08.016050 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:08.016050 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:08.016051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:08.016153 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:08.016210 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.016621 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.016713 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:53:08.017082 31515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.006478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41483 (local address 127.23.226.193:36887)
0811 18:53:08.006694 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.006747 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.007291 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.007567 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.007570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.007847 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:08.008372 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.008378 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.009327 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.009328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.010229 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.010232 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.010759 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.010760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.010891 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.011466 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:08.011474 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:08.013359 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:08.015155 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:08.015163 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:08.015166 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:08.015552 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:08.015795 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:08.015796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:08.015797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:08.015969 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:08.016236 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:08.016245 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:08.016444 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.016599 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.016805 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
I20260811 18:53:08.017700 31512 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41483
I20260811 18:53:08.017822 31512 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:08.018013 31512 heartbeater.cc:511] Master 127.23.226.254:41483 requested a full tablet report, sending...
I20260811 18:53:08.018673 31189 ts_manager.cc:194] Registered new tserver with Master: 68ebc4db0a0749b9a7f6178ab84cd6c6 (127.23.226.193:45091)
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
I20260811 18:53:08.019768 31189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:36887
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:53:08.039685 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41483
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:08.125365 31521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:08.125564 31521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:08.125588 31521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:08.126708 31521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:08.126744 31521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:08.126770 31521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:08.128278 31521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:08.128487 31521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:08.128667 31521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:08.134179 31529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:08.134181 31532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:08.134212 31530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:08.134514 31521 server_base.cc:1034] running on GCE node
I20260811 18:53:08.134758 31521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:08.135001 31521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:08.136196 31521 hybrid_clock.cc:648] HybridClock initialized: now 1786474388136185 us; error 71 us; skew 500 ppm
Aug 11 18:53:08 dist-test-slave-68xk krb5kdc[31121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474388, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:08.139189 31521 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:53:08.139559 31521 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:08.139611 31521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:08.139778 31521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:08.140866 31521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "70449bc3a9274d5fa82dc23ead701560"
format_stamp: "Formatted at 2026-08-11 18:53:08 on dist-test-slave-68xk"
server_key: "ed22cb913daa4fee7bfc3cf79ed435cf"
server_key_iv: "3f440305a16b0719bd78abab57994308"
server_key_version: "encryptionkey@0"
I20260811 18:53:08.141234 31521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "70449bc3a9274d5fa82dc23ead701560"
format_stamp: "Formatted at 2026-08-11 18:53:08 on dist-test-slave-68xk"
server_key: "ed22cb913daa4fee7bfc3cf79ed435cf"
server_key_iv: "3f440305a16b0719bd78abab57994308"
server_key_version: "encryptionkey@0"
I20260811 18:53:08.142696 31521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:08.143494 31540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:08.143723 31521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:08.143819 31521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "70449bc3a9274d5fa82dc23ead701560"
format_stamp: "Formatted at 2026-08-11 18:53:08 on dist-test-slave-68xk"
server_key: "ed22cb913daa4fee7bfc3cf79ed435cf"
server_key_iv: "3f440305a16b0719bd78abab57994308"
server_key_version: "encryptionkey@0"
I20260811 18:53:08.143879 31521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:08.159792 31521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:08.161830 31521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:08.161958 31521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:08.162159 31521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:08.162566 31521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:08.162608 31521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:08.162632 31521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:08.162678 31521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:08.169471 31521 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:39581
I20260811 18:53:08.169552 31719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:39581 every 8 connection(s)
I20260811 18:53:08.169862 31521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:08.175585 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 31521
I20260811 18:53:08.175704 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:08.175908 24459 external_mini_cluster.cc:1428] Setting key c708e1bb178065c451d616ddb4fe1fe5
Aug 11 18:53:08 dist-test-slave-68xk krb5kdc[31121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474388, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:08.180197 31260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.170661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:56677 (local address 127.23.226.254:41483)
0811 18:53:08.170716 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.170719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.170958 (+ 239us) server_negotiation.cc:407] Connection header received
0811 18:53:08.171406 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.171407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.171420 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.171481 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:08.172427 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.173126 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.174114 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.174336 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.174400 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.177009 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:08.177011 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:08.177011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:08.177021 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:08.178645 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:08.179093 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:08.179094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:08.179095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:08.179163 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:08.179467 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:08.179468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:08.179469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:08.179598 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:08.179681 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.179997 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.180096 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:53:08.180434 31723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.170593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41483 (local address 127.23.226.194:56677)
0811 18:53:08.170787 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.170832 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.171314 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.171542 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.171546 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.171829 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:08.172321 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.172327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.173218 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.173218 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.174022 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.174024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.174464 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.174465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.174577 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.175055 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:08.175063 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:08.176896 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:08.178741 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:08.178749 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:08.178752 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:08.179004 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:08.179259 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:08.179260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:08.179261 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:08.179387 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:08.179684 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:08.179693 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:08.179852 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.179972 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.180152 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260811 18:53:08.181242 31720 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41483
I20260811 18:53:08.181382 31720 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:08.181576 31720 heartbeater.cc:511] Master 127.23.226.254:41483 requested a full tablet report, sending...
I20260811 18:53:08.182060 31189 ts_manager.cc:194] Registered new tserver with Master: 70449bc3a9274d5fa82dc23ead701560 (127.23.226.194:39581)
I20260811 18:53:08.182673 31189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:56677
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:53:08.206764 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41483
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:08.291559 31728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:08.291812 31728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:08.291852 31728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:08.293000 31728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:08.293076 31728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:08.293121 31728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:08.294667 31728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:08.294955 31728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:08.295202 31728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:08.300912 31740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:08.300912 31743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:08.301046 31738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:08.301277 31728 server_base.cc:1034] running on GCE node
I20260811 18:53:08.301542 31728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:08.301810 31728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:08.302983 31728 hybrid_clock.cc:648] HybridClock initialized: now 1786474388302968 us; error 28 us; skew 500 ppm
Aug 11 18:53:08 dist-test-slave-68xk krb5kdc[31121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474388, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:08.305745 31728 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:53:08.306176 31728 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:08.306253 31728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:08.306452 31728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:08.307555 31728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "ef4ddf35889e438c84121f7c34a30223"
format_stamp: "Formatted at 2026-08-11 18:53:08 on dist-test-slave-68xk"
server_key: "cfa62f88fc569ba05ebd22954cb7991f"
server_key_iv: "74325c09612fef8f01dd4bb9cba8ae9b"
server_key_version: "encryptionkey@0"
I20260811 18:53:08.307937 31728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "ef4ddf35889e438c84121f7c34a30223"
format_stamp: "Formatted at 2026-08-11 18:53:08 on dist-test-slave-68xk"
server_key: "cfa62f88fc569ba05ebd22954cb7991f"
server_key_iv: "74325c09612fef8f01dd4bb9cba8ae9b"
server_key_version: "encryptionkey@0"
I20260811 18:53:08.309286 31728 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:53:08.310055 31749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:08.310308 31728 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:08.310451 31728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "ef4ddf35889e438c84121f7c34a30223"
format_stamp: "Formatted at 2026-08-11 18:53:08 on dist-test-slave-68xk"
server_key: "cfa62f88fc569ba05ebd22954cb7991f"
server_key_iv: "74325c09612fef8f01dd4bb9cba8ae9b"
server_key_version: "encryptionkey@0"
I20260811 18:53:08.310539 31728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:08.339408 31728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:08.341859 31728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:08.342023 31728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:08.342272 31728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:08.342662 31728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:08.342718 31728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:08.342788 31728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:08.342819 31728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:08.348968 31728 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:45663
I20260811 18:53:08.349020 31941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:45663 every 8 connection(s)
I20260811 18:53:08.349289 31728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:08.353112 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 31728
I20260811 18:53:08.353214 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:08.353397 24459 external_mini_cluster.cc:1428] Setting key e58c05a2d67cb18a749708bf669db335
Aug 11 18:53:08 dist-test-slave-68xk krb5kdc[31121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474388, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:08.359079 31260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.350039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:38031 (local address 127.23.226.254:41483)
0811 18:53:08.350084 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.350086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.350316 (+ 230us) server_negotiation.cc:407] Connection header received
0811 18:53:08.350991 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.350992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.351004 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.351057 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:08.352008 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.352518 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.353897 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.354199 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.354292 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.356504 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:08.356505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:08.356505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:08.356512 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:08.357697 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:08.358094 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:08.358095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:08.358095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:08.358154 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:08.358529 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:08.358530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:08.358530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:08.358638 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:08.358695 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.358949 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.359014 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:53:08.359257 31945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.350008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41483 (local address 127.23.226.195:38031)
0811 18:53:08.350157 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.350195 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.350880 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.351133 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.351137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.351413 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:08.351930 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.351936 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.352602 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.352602 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.353818 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.353821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.354324 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.354325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.354513 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.354966 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:08.354975 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:08.356422 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:08.357775 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:08.357782 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:08.357783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:08.357999 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:08.358265 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:08.358266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:08.358266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:08.358378 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:08.358701 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:08.358707 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:08.358828 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.358910 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.359030 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260811 18:53:08.359719 31943 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41483
I20260811 18:53:08.359813 31943 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:08.359935 31943 heartbeater.cc:511] Master 127.23.226.254:41483 requested a full tablet report, sending...
I20260811 18:53:08.360291 31189 ts_manager.cc:194] Registered new tserver with Master: ef4ddf35889e438c84121f7c34a30223 (127.23.226.195:45663)
I20260811 18:53:08.360656 31189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:38031
I20260811 18:53:08.365262 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:53:08.372795 31260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.366659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43308 (local address 127.23.226.254:41483)
0811 18:53:08.366710 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.366712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.366810 (+ 98us) server_negotiation.cc:407] Connection header received
0811 18:53:08.366849 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.366849 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.366858 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.366911 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:08.367480 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.367998 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.368750 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.368930 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.368985 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.370187 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:08.370188 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:08.370189 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:08.370195 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:08.371606 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:08.371957 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:08.371957 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:08.371958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:08.372012 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:08.372279 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:08.372280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:08.372280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:08.372452 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:08.372544 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.372658 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.372732 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:53:08.374564 31189 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:08.376082 31189 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:08.382645 31958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.378537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39581 (local address 127.0.0.1:46486)
0811 18:53:08.378880 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.378891 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.378947 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.379304 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.379308 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.379310 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:08.379383 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.379385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.380341 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.380342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.381471 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.381473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.382312 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.382313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.382402 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.382447 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.382521 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.382571 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":3,"thread_start_us":51,"threads_started":1}
I20260811 18:53:08.382697 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.378910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46486 (local address 127.23.226.194:39581)
0811 18:53:08.379101 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.379107 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.379118 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:08.379159 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.379161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.379176 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.379463 (+ 287us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:08.379541 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.380237 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.381565 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.382218 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.382300 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.382355 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.382548 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.382595 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":90,"threads_started":1}
I20260811 18:53:08.382941 31961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.378537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:45091 (local address 127.0.0.1:50290)
0811 18:53:08.378693 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.378748 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.378822 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.379313 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.379314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.379316 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:08.379399 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.379401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.380817 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.380818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.381802 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.381804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.382739 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.382740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.382811 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.382816 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.382848 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.382895 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260811 18:53:08.383266 31962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.378683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50290 (local address 127.23.226.193:45091)
0811 18:53:08.379124 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.379128 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.379137 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:08.379178 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.379180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.379194 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.379482 (+ 288us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:08.379582 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.380713 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.381881 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.382632 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.382998 (+ 366us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.383079 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.383110 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.383154 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":95,"threads_started":1}
I20260811 18:53:08.383927 31963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.378755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:45663 (local address 127.0.0.1:35980)
0811 18:53:08.379051 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.379061 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.379123 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.379472 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.379473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.379475 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:08.379516 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.379517 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.381873 (+ 2356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.381873 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.382724 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.382727 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.383684 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.383685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.383757 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.383761 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.383826 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.383864 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":74,"threads_started":1}
I20260811 18:53:08.383800 31616 tablet_service.cc:1467] Processing CreateTablet for tablet 65c4153e76e0442d847aa5d8a1895ff9 (DEFAULT_TABLE table=test-table [id=ac3b5ca477774abf9f295f2f0c42c040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:08.383985 31964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.378860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35980 (local address 127.23.226.195:45663)
0811 18:53:08.379041 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.379046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.379114 (+ 68us) server_negotiation.cc:407] Connection header received
0811 18:53:08.379286 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.379289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.379306 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.379380 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:08.379597 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.380685 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.382828 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.383583 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.383667 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.383717 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.383858 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.383900 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260811 18:53:08.384018 31408 tablet_service.cc:1467] Processing CreateTablet for tablet 65c4153e76e0442d847aa5d8a1895ff9 (DEFAULT_TABLE table=test-table [id=ac3b5ca477774abf9f295f2f0c42c040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:08.384222 31616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c4153e76e0442d847aa5d8a1895ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:08.384377 31408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c4153e76e0442d847aa5d8a1895ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:08.384734 31837 tablet_service.cc:1467] Processing CreateTablet for tablet 65c4153e76e0442d847aa5d8a1895ff9 (DEFAULT_TABLE table=test-table [id=ac3b5ca477774abf9f295f2f0c42c040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:08.385061 31837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c4153e76e0442d847aa5d8a1895ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:08.387034 31966 tablet_bootstrap.cc:492] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6: Bootstrap starting.
I20260811 18:53:08.387676 31966 tablet_bootstrap.cc:654] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:08.388023 31967 tablet_bootstrap.cc:492] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Bootstrap starting.
I20260811 18:53:08.388460 31966 log.cc:824] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:08.388473 31970 tablet_bootstrap.cc:492] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Bootstrap starting.
I20260811 18:53:08.388778 31967 tablet_bootstrap.cc:654] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:08.389240 31970 tablet_bootstrap.cc:654] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:08.389417 31967 log.cc:824] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:08.389459 31966 tablet_bootstrap.cc:492] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6: No bootstrap required, opened a new log
I20260811 18:53:08.389515 31966 ts_tablet_manager.cc:1397] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:08.389905 31970 log.cc:824] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:08.390249 31967 tablet_bootstrap.cc:492] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: No bootstrap required, opened a new log
I20260811 18:53:08.390326 31967 ts_tablet_manager.cc:1397] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:53:08.390694 31970 tablet_bootstrap.cc:492] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: No bootstrap required, opened a new log
I20260811 18:53:08.390822 31970 ts_tablet_manager.cc:1397] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:53:08.391593 31966 raft_consensus.cc:348] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.391768 31966 raft_consensus.cc:374] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:08.391809 31966 raft_consensus.cc:729] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ebc4db0a0749b9a7f6178ab84cd6c6, State: Initialized, Role: FOLLOWER
I20260811 18:53:08.391958 31966 consensus_queue.cc:260] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.392295 31512 heartbeater.cc:503] Master 127.23.226.254:41483 was elected leader, sending a full tablet report...
I20260811 18:53:08.392278 31966 ts_tablet_manager.cc:1428] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:08.392423 31967 raft_consensus.cc:348] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.392562 31967 raft_consensus.cc:374] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:08.392627 31967 raft_consensus.cc:729] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70449bc3a9274d5fa82dc23ead701560, State: Initialized, Role: FOLLOWER
I20260811 18:53:08.392652 31970 raft_consensus.cc:348] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.392807 31967 consensus_queue.cc:260] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.392848 31970 raft_consensus.cc:374] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:08.392894 31970 raft_consensus.cc:729] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4ddf35889e438c84121f7c34a30223, State: Initialized, Role: FOLLOWER
I20260811 18:53:08.393054 31970 consensus_queue.cc:260] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.393105 31720 heartbeater.cc:503] Master 127.23.226.254:41483 was elected leader, sending a full tablet report...
I20260811 18:53:08.393103 31967 ts_tablet_manager.cc:1428] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:08.393404 31970 ts_tablet_manager.cc:1428] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 18:53:08.393481 31943 heartbeater.cc:503] Master 127.23.226.254:41483 was elected leader, sending a full tablet report...
W20260811 18:53:08.420495 31722 tablet.cc:2369] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:08.506480 31514 tablet.cc:2369] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:08.599848 31944 tablet.cc:2369] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:08.755928 31975 raft_consensus.cc:482] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:08.756160 31975 raft_consensus.cc:504] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.756688 31975 leader_election.cc:288] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef4ddf35889e438c84121f7c34a30223 (127.23.226.195:45663), 70449bc3a9274d5fa82dc23ead701560 (127.23.226.194:39581)
I20260811 18:53:08.757253 31977 raft_consensus.cc:482] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:08.757391 31977 raft_consensus.cc:504] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.757742 31977 leader_election.cc:288] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68ebc4db0a0749b9a7f6178ab84cd6c6 (127.23.226.193:45091), ef4ddf35889e438c84121f7c34a30223 (127.23.226.195:45663)
I20260811 18:53:08.761312 31980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.756870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39581 (local address 127.23.226.193:53767)
0811 18:53:08.757279 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.757290 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.757367 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.757543 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.757544 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.757547 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:08.757630 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.757632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.758670 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.758672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.760152 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.760154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.761012 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.761012 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.761101 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.761106 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.761163 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.761214 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":81,"thread_start_us":64,"threads_started":1}
I20260811 18:53:08.761334 31964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.757103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:57731 (local address 127.23.226.195:45663)
0811 18:53:08.757152 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.757155 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.757229 (+ 74us) server_negotiation.cc:407] Connection header received
0811 18:53:08.757451 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.757452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.757465 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.757503 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:08.757900 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.758705 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.760260 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.760874 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.760930 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.760941 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.761214 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.761256 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:08.761574 31965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.757059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:53767 (local address 127.23.226.194:39581)
0811 18:53:08.757135 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.757138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.757356 (+ 218us) server_negotiation.cc:407] Connection header received
0811 18:53:08.757429 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.757430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.757441 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.757512 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:08.757697 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.758560 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.760265 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.760876 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.760963 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.760971 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.761425 (+ 454us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.761480 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:53:08.761861 31657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c4153e76e0442d847aa5d8a1895ff9" candidate_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70449bc3a9274d5fa82dc23ead701560" is_pre_election: true
I20260811 18:53:08.761988 31657 raft_consensus.cc:2454] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ebc4db0a0749b9a7f6178ab84cd6c6 in term 0.
I20260811 18:53:08.762148 31979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.756870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:45663 (local address 127.23.226.193:57731)
0811 18:53:08.757068 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.757084 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.757267 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.757655 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.757656 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.757658 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:08.757742 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.757744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.758801 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.758802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.760138 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.760142 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.761010 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.761011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.761109 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.761112 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.761852 (+ 740us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.761902 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":3,"thread_start_us":103,"threads_started":1}
I20260811 18:53:08.762326 31962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.757905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:36065 (local address 127.23.226.193:45091)
0811 18:53:08.757944 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.757946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.758228 (+ 282us) server_negotiation.cc:407] Connection header received
0811 18:53:08.758308 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.758309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.758317 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.758368 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:08.758761 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.759495 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.761034 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.761583 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.761625 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.761632 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.762228 (+ 596us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.762269 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":21}
I20260811 18:53:08.762451 31988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.758093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:40539 (local address 127.23.226.195:45663)
0811 18:53:08.758259 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.758261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.758573 (+ 312us) server_negotiation.cc:407] Connection header received
0811 18:53:08.758600 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.758601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.758610 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.758681 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:08.758835 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.759561 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.761029 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.761745 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.761813 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.761820 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.762307 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.762350 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260811 18:53:08.762212 31336 leader_election.cc:302] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ebc4db0a0749b9a7f6178ab84cd6c6, 70449bc3a9274d5fa82dc23ead701560; no voters:
I20260811 18:53:08.762102 31986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.758036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:45663 (local address 127.23.226.194:40539)
0811 18:53:08.758366 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.758375 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.758455 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.758683 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.758684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.758686 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:08.758755 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.758756 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.759645 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.759646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.760927 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.760931 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.761853 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.761854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.761928 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.761932 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.761981 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.762023 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":15,"thread_start_us":42,"threads_started":1}
I20260811 18:53:08.762624 31987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.757852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:45091 (local address 127.23.226.194:36065)
0811 18:53:08.758154 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.758167 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:08.758252 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:08.758434 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:08.758435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:08.758437 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:08.758513 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.758515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.759596 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.759597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.760929 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:08.760931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.761695 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.761695 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:08.762133 (+ 438us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.762138 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:08.762458 (+ 320us) client_negotiation.cc:240] Negotiation successful
0811 18:53:08.762506 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":87,"thread_start_us":79,"threads_started":1}
I20260811 18:53:08.762692 31975 raft_consensus.cc:2781] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:08.762755 31975 raft_consensus.cc:482] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:08.762779 31975 raft_consensus.cc:3037] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:08.762814 31870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c4153e76e0442d847aa5d8a1895ff9" candidate_uuid: "70449bc3a9274d5fa82dc23ead701560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4ddf35889e438c84121f7c34a30223" is_pre_election: true
I20260811 18:53:08.762979 31870 raft_consensus.cc:2454] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70449bc3a9274d5fa82dc23ead701560 in term 0.
I20260811 18:53:08.763541 31870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c4153e76e0442d847aa5d8a1895ff9" candidate_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4ddf35889e438c84121f7c34a30223" is_pre_election: true
I20260811 18:53:08.763612 31545 leader_election.cc:302] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70449bc3a9274d5fa82dc23ead701560, ef4ddf35889e438c84121f7c34a30223; no voters:
I20260811 18:53:08.763698 31870 raft_consensus.cc:2454] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ebc4db0a0749b9a7f6178ab84cd6c6 in term 0.
I20260811 18:53:08.763712 31975 raft_consensus.cc:504] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.763844 31975 leader_election.cc:288] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [CANDIDATE]: Term 1 election: Requested vote from peers ef4ddf35889e438c84121f7c34a30223 (127.23.226.195:45663), 70449bc3a9274d5fa82dc23ead701560 (127.23.226.194:39581)
I20260811 18:53:08.764024 31977 raft_consensus.cc:2781] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:08.764104 31977 raft_consensus.cc:482] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:08.764040 31657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c4153e76e0442d847aa5d8a1895ff9" candidate_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70449bc3a9274d5fa82dc23ead701560"
I20260811 18:53:08.764134 31977 raft_consensus.cc:3037] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:08.764173 31868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c4153e76e0442d847aa5d8a1895ff9" candidate_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4ddf35889e438c84121f7c34a30223"
I20260811 18:53:08.764248 31868 raft_consensus.cc:3037] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:08.764855 31977 raft_consensus.cc:504] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.765025 31977 leader_election.cc:288] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [CANDIDATE]: Term 1 election: Requested vote from peers 68ebc4db0a0749b9a7f6178ab84cd6c6 (127.23.226.193:45091), ef4ddf35889e438c84121f7c34a30223 (127.23.226.195:45663)
I20260811 18:53:08.765101 31657 raft_consensus.cc:2379] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 68ebc4db0a0749b9a7f6178ab84cd6c6 in current term 1: Already voted for candidate 70449bc3a9274d5fa82dc23ead701560 in this term.
I20260811 18:53:08.765136 31868 raft_consensus.cc:2454] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ebc4db0a0749b9a7f6178ab84cd6c6 in term 1.
I20260811 18:53:08.765242 31436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c4153e76e0442d847aa5d8a1895ff9" candidate_uuid: "70449bc3a9274d5fa82dc23ead701560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" is_pre_election: true
I20260811 18:53:08.765331 31335 leader_election.cc:302] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ebc4db0a0749b9a7f6178ab84cd6c6, ef4ddf35889e438c84121f7c34a30223; no voters:
I20260811 18:53:08.765396 31436 raft_consensus.cc:2379] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70449bc3a9274d5fa82dc23ead701560 in current term 1: Already voted for candidate 68ebc4db0a0749b9a7f6178ab84cd6c6 in this term.
I20260811 18:53:08.765394 31868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c4153e76e0442d847aa5d8a1895ff9" candidate_uuid: "70449bc3a9274d5fa82dc23ead701560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef4ddf35889e438c84121f7c34a30223"
I20260811 18:53:08.765450 31975 raft_consensus.cc:2781] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:08.765489 31868 raft_consensus.cc:2379] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70449bc3a9274d5fa82dc23ead701560 in current term 1: Already voted for candidate 68ebc4db0a0749b9a7f6178ab84cd6c6 in this term.
I20260811 18:53:08.765602 31975 raft_consensus.cc:686] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [term 1 LEADER]: Becoming Leader. State: Replica: 68ebc4db0a0749b9a7f6178ab84cd6c6, State: Running, Role: LEADER
I20260811 18:53:08.765636 31434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c4153e76e0442d847aa5d8a1895ff9" candidate_uuid: "70449bc3a9274d5fa82dc23ead701560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6"
I20260811 18:53:08.765707 31975 consensus_queue.cc:237] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } }
I20260811 18:53:08.766223 31545 leader_election.cc:302] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70449bc3a9274d5fa82dc23ead701560; no voters: 68ebc4db0a0749b9a7f6178ab84cd6c6, ef4ddf35889e438c84121f7c34a30223
I20260811 18:53:08.766356 31977 raft_consensus.cc:2726] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 18:53:08.766607 31190 catalog_manager.cc:5495] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ebc4db0a0749b9a7f6178ab84cd6c6 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ebc4db0a0749b9a7f6178ab84cd6c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 45091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:08.827699 31962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.825367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50304 (local address 127.23.226.193:45091)
0811 18:53:08.825414 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:08.825416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:08.825424 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:53:08.825473 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:08.825474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:08.825493 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:08.825563 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:08.825683 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.826200 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.827035 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:08.827234 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:08.827309 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:08.827426 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:08.827528 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:08.827586 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:08.827620 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 18:53:08.827640 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:08.829782 31868 raft_consensus.cc:1261] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 1 FOLLOWER]: Refusing update from remote peer 68ebc4db0a0749b9a7f6178ab84cd6c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:08.829782 31657 raft_consensus.cc:1261] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 1 FOLLOWER]: Refusing update from remote peer 68ebc4db0a0749b9a7f6178ab84cd6c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:08.830191 31991 consensus_queue.cc:1035] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70449bc3a9274d5fa82dc23ead701560" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:08.830389 31991 consensus_queue.cc:1035] T 65c4153e76e0442d847aa5d8a1895ff9 P 68ebc4db0a0749b9a7f6178ab84cd6c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef4ddf35889e438c84121f7c34a30223" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:08.833010 32011 mvcc.cc:205] Tried to move back new op lower bound from 7317399096643473408 to 7317399096385019904. Current Snapshot: MvccSnapshot[applied={T|T < 7317399096643473408}]
I20260811 18:53:08.833580 32009 mvcc.cc:205] Tried to move back new op lower bound from 7317399096643473408 to 7317399096385019904. Current Snapshot: MvccSnapshot[applied={T|T < 7317399096643473408}]
I20260811 18:53:08.835211 31189 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:08.835314 31189 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:08.836136 31189 catalog_manager.cc:5782] T 00000000000000000000000000000000 P deaeb07db50c4739a8bd7bc97f156734: Sending DeleteTablet for 3 replicas of tablet 65c4153e76e0442d847aa5d8a1895ff9
I20260811 18:53:08.836465 31408 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c4153e76e0442d847aa5d8a1895ff9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:08 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:50290
I20260811 18:53:08.836485 31616 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c4153e76e0442d847aa5d8a1895ff9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:08 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:46486
I20260811 18:53:08.836529 31837 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c4153e76e0442d847aa5d8a1895ff9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:08 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:35980
I20260811 18:53:08.837013 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 31298
I20260811 18:53:08.847594 32027 tablet_replica.cc:330] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: stopping tablet replica
I20260811 18:53:08.847815 32027 raft_consensus.cc:2229] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:08.848021 32027 raft_consensus.cc:2258] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:08.848758 32024 tablet_replica.cc:330] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: stopping tablet replica
I20260811 18:53:08.848901 32024 raft_consensus.cc:2229] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:08.849041 32024 raft_consensus.cc:2258] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:08.849048 32027 ts_tablet_manager.cc:1905] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:08.849570 32024 ts_tablet_manager.cc:1905] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:08.850845 32027 ts_tablet_manager.cc:1918] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:08.850943 32027 log.cc:1196] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/65c4153e76e0442d847aa5d8a1895ff9
I20260811 18:53:08.851263 32027 ts_tablet_manager.cc:1939] T 65c4153e76e0442d847aa5d8a1895ff9 P ef4ddf35889e438c84121f7c34a30223: Deleting consensus metadata
I20260811 18:53:08.851754 31169 catalog_manager.cc:4841] TS ef4ddf35889e438c84121f7c34a30223 (127.23.226.195:45663): tablet 65c4153e76e0442d847aa5d8a1895ff9 (table test-table [id=ac3b5ca477774abf9f295f2f0c42c040]) successfully deleted
I20260811 18:53:08.851852 32024 ts_tablet_manager.cc:1918] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:08.851948 32024 log.cc:1196] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/65c4153e76e0442d847aa5d8a1895ff9
I20260811 18:53:08.852276 32024 ts_tablet_manager.cc:1939] T 65c4153e76e0442d847aa5d8a1895ff9 P 70449bc3a9274d5fa82dc23ead701560: Deleting consensus metadata
I20260811 18:53:08.852797 31170 catalog_manager.cc:4841] TS 70449bc3a9274d5fa82dc23ead701560 (127.23.226.194:39581): tablet 65c4153e76e0442d847aa5d8a1895ff9 (table test-table [id=ac3b5ca477774abf9f295f2f0c42c040]) successfully deleted
W20260811 18:53:08.854938 31169 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:45091 (error 108)
I20260811 18:53:08.855105 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 31521
I20260811 18:53:08.862857 31963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:08.862685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:45091 (local address 127.0.0.1:50318)
0811 18:53:08.862753 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:08.862820 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:45091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 18:53:08.863070 31169 catalog_manager.cc:4584] TS 68ebc4db0a0749b9a7f6178ab84cd6c6 (127.23.226.193:45091): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 65c4153e76e0442d847aa5d8a1895ff9: Network error: Client connection negotiation failed: client connection to 127.23.226.193:45091: connect: Connection refused (error 111)
I20260811 18:53:08.866971 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 31728
I20260811 18:53:08.886981 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 31142
2026-08-11T18:53:08Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2599 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T18:53:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:08Z Disabled control of system clock
I20260811 18:53:08.922132 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:34379
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:34379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:53:09.004410 32039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:09.004786 32039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:09.004848 32039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:09.006028 32039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:09.006070 32039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:09.006083 32039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:09.006131 32039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:09.006161 32039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:09.008697 32039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:34379
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:34379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:09.008967 32039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:09.009307 32039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:09.015666 32047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.015673 32045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.015765 32050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:09.015882 32039 server_base.cc:1034] running on GCE node
I20260811 18:53:09.016152 32039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:09.016530 32039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:09.017750 32039 hybrid_clock.cc:648] HybridClock initialized: now 1786474389017770 us; error 67 us; skew 500 ppm
I20260811 18:53:09.019068 32039 webserver.cc:460] Webserver started at http://127.23.226.254:40509/ using document root <none> and password file <none>
I20260811 18:53:09.019340 32039 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:09.019415 32039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:09.019572 32039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:09.020686 32039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "07cf73ecead9419c9836e83597fd5fc1"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "3ad0c970af2f1bd3180805a7b7c9f1b1"
server_key_iv: "4eb41f26b8c0526aba40d3ad61f05c29"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.021046 32039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "07cf73ecead9419c9836e83597fd5fc1"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "3ad0c970af2f1bd3180805a7b7c9f1b1"
server_key_iv: "4eb41f26b8c0526aba40d3ad61f05c29"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.022382 32039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:09.023144 32057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.023447 32039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:09.023554 32039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "07cf73ecead9419c9836e83597fd5fc1"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "3ad0c970af2f1bd3180805a7b7c9f1b1"
server_key_iv: "4eb41f26b8c0526aba40d3ad61f05c29"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.023633 32039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:09.027070 32039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:09.027354 32039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:09.027498 32039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:09.031536 32039 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:34379
I20260811 18:53:09.031569 32134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:34379 every 8 connection(s)
I20260811 18:53:09.031886 32039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:09.032533 32138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:09.035418 32138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1: Bootstrap starting.
I20260811 18:53:09.035964 32138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:09.036223 32138 log.cc:824] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:09.036736 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 32039
I20260811 18:53:09.036846 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:09.036948 32138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1: No bootstrap required, opened a new log
I20260811 18:53:09.037029 24459 external_mini_cluster.cc:1428] Setting key 10fae35a850531f932222f8d9de3db9b
I20260811 18:53:09.039357 32138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07cf73ecead9419c9836e83597fd5fc1" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34379 } }
I20260811 18:53:09.039556 32138 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:09.039615 32138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07cf73ecead9419c9836e83597fd5fc1, State: Initialized, Role: FOLLOWER
I20260811 18:53:09.039708 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.037541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37260 (local address 127.23.226.254:34379)
0811 18:53:09.037765 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.037772 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.037797 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:53:09.038271 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.038278 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.038315 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.038479 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.039163 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.039166 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.039166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.039170 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.039230 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.039240 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.039297 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.039390 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.039457 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":100,"threads_started":1}
I20260811 18:53:09.039747 32138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07cf73ecead9419c9836e83597fd5fc1" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34379 } }
I20260811 18:53:09.039871 32138 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:09.039903 32138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:09.039947 32138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:09.040809 32138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07cf73ecead9419c9836e83597fd5fc1" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34379 } }
I20260811 18:53:09.040932 32138 leader_election.cc:302] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07cf73ecead9419c9836e83597fd5fc1; no voters:
I20260811 18:53:09.041093 32138 leader_election.cc:288] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:09.041116 32146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:09.041266 32146 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [term 1 LEADER]: Becoming Leader. State: Replica: 07cf73ecead9419c9836e83597fd5fc1, State: Running, Role: LEADER
I20260811 18:53:09.041375 32138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:09.041375 32146 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07cf73ecead9419c9836e83597fd5fc1" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34379 } }
I20260811 18:53:09.041823 32148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07cf73ecead9419c9836e83597fd5fc1. Latest consensus state: current_term: 1 leader_uuid: "07cf73ecead9419c9836e83597fd5fc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07cf73ecead9419c9836e83597fd5fc1" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34379 } } }
I20260811 18:53:09.041846 32147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07cf73ecead9419c9836e83597fd5fc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07cf73ecead9419c9836e83597fd5fc1" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34379 } } }
I20260811 18:53:09.042034 32147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:09.042016 32148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:09.042384 32158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:09.042949 32158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:09.044600 32158 catalog_manager.cc:1347] Generated new cluster ID: 700639032535445684db1229245db56a
I20260811 18:53:09.044656 32158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:09.052879 32158 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:09.053109 32158 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:09.061105 32158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1: Generated new TSK 0
I20260811 18:53:09.061298 32158 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:09.063701 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:34379
--builtin_ntp_servers=127.23.226.212:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:53:09.156630 32174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:09.156827 32174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:09.156849 32174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:09.158003 32174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:09.158052 32174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:09.158079 32174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:09.159471 32174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:34379
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:09.159708 32174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:09.160002 32174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:09.165064 32184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.165150 32187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.165074 32182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:09.165333 32174 server_base.cc:1034] running on GCE node
I20260811 18:53:09.165534 32174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:09.165786 32174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:09.166967 32174 hybrid_clock.cc:648] HybridClock initialized: now 1786474389166949 us; error 31 us; skew 500 ppm
I20260811 18:53:09.168537 32174 webserver.cc:460] Webserver started at http://127.23.226.193:40689/ using document root <none> and password file <none>
I20260811 18:53:09.168823 32174 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:09.168898 32174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:09.169051 32174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:09.170198 32174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "98b1bef10a4540fba47ef949f8c418b9"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "224af093ce51c9bc057c40b96e08ebcb"
server_key_iv: "f01c47490015bb00c59a93cdb381f369"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.170611 32174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "98b1bef10a4540fba47ef949f8c418b9"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "224af093ce51c9bc057c40b96e08ebcb"
server_key_iv: "f01c47490015bb00c59a93cdb381f369"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.172053 32174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:09.172894 32198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.173089 32174 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:09.173166 32174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "98b1bef10a4540fba47ef949f8c418b9"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "224af093ce51c9bc057c40b96e08ebcb"
server_key_iv: "f01c47490015bb00c59a93cdb381f369"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.173264 32174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:09.176844 32174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:09.177156 32174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:09.177332 32174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:09.177594 32174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:09.177999 32174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:09.178057 32174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.178102 32174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:09.178128 32174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.184882 32174 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:33185
I20260811 18:53:09.185362 32174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:09.185580 32370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:33185 every 8 connection(s)
I20260811 18:53:09.188602 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.186175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:39685 (local address 127.23.226.254:34379)
0811 18:53:09.186286 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.186289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.186574 (+ 285us) server_negotiation.cc:407] Connection header received
0811 18:53:09.187123 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.187124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.187131 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.187180 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.188336 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.188338 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.188338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.188343 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.188358 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.188362 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.188415 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.188515 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.188532 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:53:09.188817 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.186150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:34379 (local address 127.23.226.193:39685)
0811 18:53:09.186385 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.186485 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:09.187001 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:09.187260 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:09.187265 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:09.187273 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:09.188179 (+ 906us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:09.188179 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:09.188208 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:09.188238 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:09.188413 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:09.188418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:09.188422 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:09.188513 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:53:09.188580 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260811 18:53:09.189401 32372 heartbeater.cc:347] Connected to a master server at 127.23.226.254:34379
I20260811 18:53:09.189482 32372 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:09.189656 32372 heartbeater.cc:511] Master 127.23.226.254:34379 requested a full tablet report, sending...
I20260811 18:53:09.190361 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 32174
I20260811 18:53:09.190443 32083 ts_manager.cc:194] Registered new tserver with Master: 98b1bef10a4540fba47ef949f8c418b9 (127.23.226.193:33185)
I20260811 18:53:09.190478 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:09.190668 24459 external_mini_cluster.cc:1428] Setting key 0860dab9e47be3962f566a934422c1e1
I20260811 18:53:09.191684 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:34379
--builtin_ntp_servers=127.23.226.212:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:53:09.275645 32390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:09.275897 32390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:09.275987 32390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:09.277252 32390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:09.277312 32390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:09.277359 32390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:09.278911 32390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:34379
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:09.279186 32390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:09.279502 32390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:09.284806 32403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.284807 32397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.284950 32398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:09.285053 32390 server_base.cc:1034] running on GCE node
I20260811 18:53:09.285295 32390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:09.285557 32390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:09.286739 32390 hybrid_clock.cc:648] HybridClock initialized: now 1786474389286707 us; error 46 us; skew 500 ppm
I20260811 18:53:09.288111 32390 webserver.cc:460] Webserver started at http://127.23.226.194:40343/ using document root <none> and password file <none>
I20260811 18:53:09.288381 32390 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:09.288429 32390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:09.288599 32390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:09.289712 32390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "3ef3a0f98fc5488b82cdfcba2669a697"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "4642c6ef5c89bae1445778f774dc433e"
server_key_iv: "d5fc050c3fb6df71d94deaac4cd2bef1"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.290086 32390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "3ef3a0f98fc5488b82cdfcba2669a697"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "4642c6ef5c89bae1445778f774dc433e"
server_key_iv: "d5fc050c3fb6df71d94deaac4cd2bef1"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.291538 32390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:09.292387 32414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.292631 32390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:09.292711 32390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "3ef3a0f98fc5488b82cdfcba2669a697"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "4642c6ef5c89bae1445778f774dc433e"
server_key_iv: "d5fc050c3fb6df71d94deaac4cd2bef1"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.292814 32390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:09.296289 32390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:09.296567 32390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:09.296700 32390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:09.296937 32390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:09.297273 32390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:09.297308 32390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.297355 32390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:09.297384 32390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.303570 32390 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:44939
I20260811 18:53:09.303622 32601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:44939 every 8 connection(s)
I20260811 18:53:09.303961 32390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:09.307157 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 32390
I20260811 18:53:09.307237 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.304731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:52675 (local address 127.23.226.254:34379)
0811 18:53:09.304806 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.304808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.305078 (+ 270us) server_negotiation.cc:407] Connection header received
0811 18:53:09.305663 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.305665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.305672 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.305729 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.306947 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.306948 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.306948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.306953 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.306977 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.306981 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.307050 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.307146 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.307162 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 18:53:09.307301 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:09.307431 32604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.304706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:34379 (local address 127.23.226.194:52675)
0811 18:53:09.304945 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.304981 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:09.305535 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:09.305800 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:09.305803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:09.305812 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:09.306787 (+ 975us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:09.306787 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:09.306816 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:09.306844 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:09.307048 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:09.307055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:09.307058 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:09.307158 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:53:09.307230 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":112,"threads_started":1}
I20260811 18:53:09.307511 24459 external_mini_cluster.cc:1428] Setting key 6c68ecc576a390cb6e7d52dd5ef66914
I20260811 18:53:09.307950 32602 heartbeater.cc:347] Connected to a master server at 127.23.226.254:34379
I20260811 18:53:09.308056 32602 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:09.308223 32602 heartbeater.cc:511] Master 127.23.226.254:34379 requested a full tablet report, sending...
I20260811 18:53:09.308629 32083 ts_manager.cc:194] Registered new tserver with Master: 3ef3a0f98fc5488b82cdfcba2669a697 (127.23.226.194:44939)
I20260811 18:53:09.308662 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:34379
--builtin_ntp_servers=127.23.226.212:37243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 18:53:09.392617 32606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:09.392819 32606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:09.392841 32606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:09.393990 32606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:09.394032 32606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:09.394057 32606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:09.395552 32606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:34379
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:09.395790 32606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:09.396080 32606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:09.401216 32613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.401211 32618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.401257 32614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:09.401402 32606 server_base.cc:1034] running on GCE node
I20260811 18:53:09.401659 32606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:09.401859 32606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:09.403038 32606 hybrid_clock.cc:648] HybridClock initialized: now 1786474389403014 us; error 42 us; skew 500 ppm
I20260811 18:53:09.404273 32606 webserver.cc:460] Webserver started at http://127.23.226.195:36769/ using document root <none> and password file <none>
I20260811 18:53:09.404508 32606 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:09.404553 32606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:09.404726 32606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:09.405817 32606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "622bfb5f26c6462dbb0328fc7b419cd0"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "5e5b7ba6251a734a53914b1382fa2550"
server_key_iv: "07c5cbb7e1c77d967a37ee388fd5e943"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.406176 32606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "622bfb5f26c6462dbb0328fc7b419cd0"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "5e5b7ba6251a734a53914b1382fa2550"
server_key_iv: "07c5cbb7e1c77d967a37ee388fd5e943"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.407598 32606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:53:09.408408 32628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.408624 32606 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:09.408728 32606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "622bfb5f26c6462dbb0328fc7b419cd0"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "5e5b7ba6251a734a53914b1382fa2550"
server_key_iv: "07c5cbb7e1c77d967a37ee388fd5e943"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.408816 32606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:09.412240 32606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:09.412516 32606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:09.412693 32606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:09.412926 32606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:09.413311 32606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:09.413362 32606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.413399 32606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:09.413427 32606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.419354 32606 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:44191
I20260811 18:53:09.419456 353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:44191 every 8 connection(s)
I20260811 18:53:09.419786 32606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:09.422855 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.420587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:33549 (local address 127.23.226.254:34379)
0811 18:53:09.420652 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.420654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.420870 (+ 216us) server_negotiation.cc:407] Connection header received
0811 18:53:09.421327 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.421329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.421335 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.421389 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.422666 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.422667 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.422667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.422671 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.422682 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.422686 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.422741 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.422791 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.422803 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:53:09.423038 356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.420576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:34379 (local address 127.23.226.195:33549)
0811 18:53:09.420762 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.420795 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:09.421228 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:09.421459 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:09.421462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:09.421470 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:09.422535 (+ 1065us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:09.422536 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:09.422563 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:09.422592 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:09.422743 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:09.422745 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:09.422747 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:53:09.422798 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 18:53:09.422845 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260811 18:53:09.423738 354 heartbeater.cc:347] Connected to a master server at 127.23.226.254:34379
I20260811 18:53:09.423825 354 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:09.423941 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 32606
I20260811 18:53:09.423977 354 heartbeater.cc:511] Master 127.23.226.254:34379 requested a full tablet report, sending...
I20260811 18:53:09.424054 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:09.424233 24459 external_mini_cluster.cc:1428] Setting key 7471518c0f30596079bb6139a8d00f7a
I20260811 18:53:09.424443 32083 ts_manager.cc:194] Registered new tserver with Master: 622bfb5f26c6462dbb0328fc7b419cd0 (127.23.226.195:44191)
I20260811 18:53:09.425091 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:53:09.427553 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.426447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37274 (local address 127.23.226.254:34379)
0811 18:53:09.426492 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.426494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.426649 (+ 155us) server_negotiation.cc:407] Connection header received
0811 18:53:09.426723 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.426724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.426729 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.426778 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.427324 (+ 546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.427325 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.427326 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.427330 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.427341 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.427345 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.427401 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.427478 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.427491 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:53:09.428948 32083 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37274:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:09.430404 32083 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:09.434365 368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.432497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:44939 (local address 127.0.0.1:48612)
0811 18:53:09.432840 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.432881 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:09.432934 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:09.433195 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:09.433201 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:09.433207 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:09.433803 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:09.433804 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:09.433818 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:09.433839 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:09.434158 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:09.434165 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:09.434168 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:09.434267 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 18:53:09.434282 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":57,"threads_started":1}
I20260811 18:53:09.434384 370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.432859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48612 (local address 127.23.226.194:44939)
0811 18:53:09.433058 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.433063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.433073 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:09.433100 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.433102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.433111 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.433188 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.434045 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.434049 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.434049 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.434053 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.434083 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.434097 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.434164 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.434284 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.434301 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":95,"threads_started":1}
I20260811 18:53:09.434641 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.432507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:33185 (local address 127.0.0.1:55902)
0811 18:53:09.432928 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.432938 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:09.433021 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:09.433226 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:09.433227 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:09.433230 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:09.433881 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:09.433882 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:09.433890 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:09.433906 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:09.434165 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:09.434166 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:09.434174 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 18:53:09.434217 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 18:53:09.434230 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":89,"threads_started":1}
I20260811 18:53:09.434758 364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.432695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:44191 (local address 127.0.0.1:58276)
0811 18:53:09.433054 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.433064 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:09.433102 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:09.433814 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:09.433815 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:09.433817 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:09.434238 (+ 421us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:09.434239 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:09.434244 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:09.434254 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:09.434624 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:09.434625 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:09.434626 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:53:09.434686 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 18:53:09.434699 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":83,"threads_started":1}
I20260811 18:53:09.434923 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.432771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58276 (local address 127.23.226.195:44191)
0811 18:53:09.433155 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.433159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.433168 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:09.433190 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.433192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.433200 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.433518 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.434336 (+ 818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.434345 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.434345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.434350 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.434383 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.434404 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.434614 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.434767 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.434785 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":71,"threads_started":1}
I20260811 18:53:09.434978 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.432635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55902 (local address 127.23.226.193:33185)
0811 18:53:09.432857 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.432862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.432996 (+ 134us) server_negotiation.cc:407] Connection header received
0811 18:53:09.433094 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.433101 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.433111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.433420 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.434003 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.434010 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.434011 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.434016 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.434056 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.434083 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.434337 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.434361 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.434379 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":96,"threads_started":1}
I20260811 18:53:09.435220 32490 tablet_service.cc:1467] Processing CreateTablet for tablet 593a4d1b01a94f49adaa7aec9c6d3b95 (DEFAULT_TABLE table=test-table [id=c516266802cb460caedecf620a35e07f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:09.435633 32490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 593a4d1b01a94f49adaa7aec9c6d3b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:09.435842 32272 tablet_service.cc:1467] Processing CreateTablet for tablet 593a4d1b01a94f49adaa7aec9c6d3b95 (DEFAULT_TABLE table=test-table [id=c516266802cb460caedecf620a35e07f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:09.436158 32272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 593a4d1b01a94f49adaa7aec9c6d3b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:09.438351 372 tablet_bootstrap.cc:492] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Bootstrap starting.
I20260811 18:53:09.438612 373 tablet_bootstrap.cc:492] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9: Bootstrap starting.
I20260811 18:53:09.439150 372 tablet_bootstrap.cc:654] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:09.439342 373 tablet_bootstrap.cc:654] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:09.439334 32704 tablet_service.cc:1467] Processing CreateTablet for tablet 593a4d1b01a94f49adaa7aec9c6d3b95 (DEFAULT_TABLE table=test-table [id=c516266802cb460caedecf620a35e07f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:09.439626 372 log.cc:824] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:09.439687 32704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 593a4d1b01a94f49adaa7aec9c6d3b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:09.439677 373 log.cc:824] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:09.440478 373 tablet_bootstrap.cc:492] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9: No bootstrap required, opened a new log
I20260811 18:53:09.440557 373 ts_tablet_manager.cc:1397] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:09.440632 372 tablet_bootstrap.cc:492] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: No bootstrap required, opened a new log
I20260811 18:53:09.440754 372 ts_tablet_manager.cc:1397] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 18:53:09.442996 372 raft_consensus.cc:348] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.443149 372 raft_consensus.cc:374] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:09.443192 372 raft_consensus.cc:729] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef3a0f98fc5488b82cdfcba2669a697, State: Initialized, Role: FOLLOWER
I20260811 18:53:09.443207 373 raft_consensus.cc:348] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.443316 372 consensus_queue.cc:260] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.443379 373 raft_consensus.cc:374] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:09.443418 373 raft_consensus.cc:729] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b1bef10a4540fba47ef949f8c418b9, State: Initialized, Role: FOLLOWER
I20260811 18:53:09.443533 373 consensus_queue.cc:260] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.443595 372 ts_tablet_manager.cc:1428] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:09.443579 377 tablet_bootstrap.cc:492] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Bootstrap starting.
I20260811 18:53:09.443737 32602 heartbeater.cc:503] Master 127.23.226.254:34379 was elected leader, sending a full tablet report...
I20260811 18:53:09.443792 373 ts_tablet_manager.cc:1428] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 18:53:09.443912 32372 heartbeater.cc:503] Master 127.23.226.254:34379 was elected leader, sending a full tablet report...
I20260811 18:53:09.444581 377 tablet_bootstrap.cc:654] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:09.444941 377 log.cc:824] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:09.445794 377 tablet_bootstrap.cc:492] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: No bootstrap required, opened a new log
I20260811 18:53:09.445866 377 ts_tablet_manager.cc:1397] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:09.447671 377 raft_consensus.cc:348] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.447800 377 raft_consensus.cc:374] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:09.447824 377 raft_consensus.cc:729] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622bfb5f26c6462dbb0328fc7b419cd0, State: Initialized, Role: FOLLOWER
I20260811 18:53:09.447930 377 consensus_queue.cc:260] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.448194 377 ts_tablet_manager.cc:1428] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 18:53:09.448256 354 heartbeater.cc:503] Master 127.23.226.254:34379 was elected leader, sending a full tablet report...
W20260811 18:53:09.554590 32603 tablet.cc:2369] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:09.670455 355 tablet.cc:2369] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:09.686163 32374 tablet.cc:2369] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:09.715483 380 raft_consensus.cc:482] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:09.715654 380 raft_consensus.cc:504] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.716096 380 leader_election.cc:288] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ef3a0f98fc5488b82cdfcba2669a697 (127.23.226.194:44939), 622bfb5f26c6462dbb0328fc7b419cd0 (127.23.226.195:44191)
I20260811 18:53:09.717641 370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.716521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:56461 (local address 127.23.226.194:44939)
0811 18:53:09.716578 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.716580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.716592 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:53:09.716629 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.716630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.716637 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.716733 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.717380 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.717382 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.717382 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.717387 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.717407 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.717412 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.717481 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.717558 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.717571 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:53:09.717674 383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.716289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:44939 (local address 127.23.226.193:56461)
0811 18:53:09.716432 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.716446 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:09.716504 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:09.716739 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:09.716741 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:09.716745 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:09.717261 (+ 516us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:09.717262 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:09.717269 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:09.717282 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:09.717493 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:09.717494 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:09.717495 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:53:09.717550 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 18:53:09.717568 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260811 18:53:09.717825 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.716617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:46125 (local address 127.23.226.195:44191)
0811 18:53:09.716685 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.716687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.716698 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:09.716764 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.716765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.716771 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.716834 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.717552 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.717553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.717554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.717558 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.717574 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.717578 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.717651 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.717703 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.717726 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:53:09.717932 384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.716493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:44191 (local address 127.23.226.193:46125)
0811 18:53:09.716645 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.716656 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:09.716705 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:09.716850 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:09.716851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:09.716853 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:09.717438 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:09.717439 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:09.717446 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:09.717458 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:09.717649 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:09.717650 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:09.717651 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:53:09.717827 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 18:53:09.717844 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":40,"threads_started":1}
I20260811 18:53:09.718060 32521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593a4d1b01a94f49adaa7aec9c6d3b95" candidate_uuid: "98b1bef10a4540fba47ef949f8c418b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" is_pre_election: true
I20260811 18:53:09.718245 32521 raft_consensus.cc:2454] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b1bef10a4540fba47ef949f8c418b9 in term 0.
I20260811 18:53:09.718451 32733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593a4d1b01a94f49adaa7aec9c6d3b95" candidate_uuid: "98b1bef10a4540fba47ef949f8c418b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" is_pre_election: true
I20260811 18:53:09.718562 32203 leader_election.cc:302] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef3a0f98fc5488b82cdfcba2669a697, 98b1bef10a4540fba47ef949f8c418b9; no voters:
I20260811 18:53:09.718586 32733 raft_consensus.cc:2454] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b1bef10a4540fba47ef949f8c418b9 in term 0.
I20260811 18:53:09.718700 380 raft_consensus.cc:2781] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:09.718775 380 raft_consensus.cc:482] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:09.718802 380 raft_consensus.cc:3037] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:09.719743 380 raft_consensus.cc:504] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.719879 380 leader_election.cc:288] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [CANDIDATE]: Term 1 election: Requested vote from peers 3ef3a0f98fc5488b82cdfcba2669a697 (127.23.226.194:44939), 622bfb5f26c6462dbb0328fc7b419cd0 (127.23.226.195:44191)
I20260811 18:53:09.720062 32521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593a4d1b01a94f49adaa7aec9c6d3b95" candidate_uuid: "98b1bef10a4540fba47ef949f8c418b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef3a0f98fc5488b82cdfcba2669a697"
I20260811 18:53:09.720110 32733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "593a4d1b01a94f49adaa7aec9c6d3b95" candidate_uuid: "98b1bef10a4540fba47ef949f8c418b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622bfb5f26c6462dbb0328fc7b419cd0"
I20260811 18:53:09.720170 32521 raft_consensus.cc:3037] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:09.720207 32733 raft_consensus.cc:3037] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:09.720935 32733 raft_consensus.cc:2454] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b1bef10a4540fba47ef949f8c418b9 in term 1.
I20260811 18:53:09.721035 32521 raft_consensus.cc:2454] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b1bef10a4540fba47ef949f8c418b9 in term 1.
I20260811 18:53:09.721100 32203 leader_election.cc:302] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 622bfb5f26c6462dbb0328fc7b419cd0, 98b1bef10a4540fba47ef949f8c418b9; no voters:
I20260811 18:53:09.721215 380 raft_consensus.cc:2781] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:09.721369 380 raft_consensus.cc:686] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [term 1 LEADER]: Becoming Leader. State: Replica: 98b1bef10a4540fba47ef949f8c418b9, State: Running, Role: LEADER
I20260811 18:53:09.721446 380 consensus_queue.cc:237] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } }
I20260811 18:53:09.722339 32082 catalog_manager.cc:5495] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b1bef10a4540fba47ef949f8c418b9 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "98b1bef10a4540fba47ef949f8c418b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b1bef10a4540fba47ef949f8c418b9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 33185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:09.792964 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.791874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55906 (local address 127.23.226.193:33185)
0811 18:53:09.791964 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:09.791966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:09.791973 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:53:09.792013 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:09.792014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:09.792028 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:09.792106 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:09.792699 (+ 593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:09.792700 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:09.792701 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:09.792705 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:09.792722 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:09.792726 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:09.792800 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:09.792857 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 18:53:09.792871 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:53:09.795029 32733 raft_consensus.cc:1261] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 1 FOLLOWER]: Refusing update from remote peer 98b1bef10a4540fba47ef949f8c418b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:09.795029 32521 raft_consensus.cc:1261] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 1 FOLLOWER]: Refusing update from remote peer 98b1bef10a4540fba47ef949f8c418b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:09.795456 380 consensus_queue.cc:1035] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef3a0f98fc5488b82cdfcba2669a697" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:09.795665 385 consensus_queue.cc:1035] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "622bfb5f26c6462dbb0328fc7b419cd0" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:09.798502 392 mvcc.cc:205] Tried to move back new op lower bound from 7317399100597366784 to 7317399100299751424. Current Snapshot: MvccSnapshot[applied={T|T < 7317399100597366784}]
I20260811 18:53:09.798857 394 mvcc.cc:205] Tried to move back new op lower bound from 7317399100597366784 to 7317399100299751424. Current Snapshot: MvccSnapshot[applied={T|T < 7317399100597366784}]
I20260811 18:53:09.801100 32083 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:09.801194 32083 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:09.801960 32083 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07cf73ecead9419c9836e83597fd5fc1: Sending DeleteTablet for 3 replicas of tablet 593a4d1b01a94f49adaa7aec9c6d3b95
I20260811 18:53:09.802346 32704 tablet_service.cc:1514] Processing DeleteTablet for tablet 593a4d1b01a94f49adaa7aec9c6d3b95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:09 UTC) from {username='slave'} at 127.0.0.1:58276
I20260811 18:53:09.802387 32490 tablet_service.cc:1514] Processing DeleteTablet for tablet 593a4d1b01a94f49adaa7aec9c6d3b95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:09 UTC) from {username='slave'} at 127.0.0.1:48612
I20260811 18:53:09.802627 32272 tablet_service.cc:1514] Processing DeleteTablet for tablet 593a4d1b01a94f49adaa7aec9c6d3b95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:09 UTC) from {username='slave'} at 127.0.0.1:55902
I20260811 18:53:09.802871 407 tablet_replica.cc:330] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 98b1bef10a4540fba47ef949f8c418b9: stopping tablet replica
I20260811 18:53:09.802878 404 tablet_replica.cc:330] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: stopping tablet replica
I20260811 18:53:09.802964 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 32174
I20260811 18:53:09.802989 404 raft_consensus.cc:2229] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:09.807610 404 raft_consensus.cc:2258] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:09.814000 404 ts_tablet_manager.cc:1905] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:09.814472 405 tablet_replica.cc:330] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: stopping tablet replica
I20260811 18:53:09.814615 405 raft_consensus.cc:2229] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:09.814769 405 raft_consensus.cc:2258] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:09.815227 405 ts_tablet_manager.cc:1905] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:09.816121 404 ts_tablet_manager.cc:1918] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:09.816216 404 log.cc:1196] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/593a4d1b01a94f49adaa7aec9c6d3b95
I20260811 18:53:09.816506 404 ts_tablet_manager.cc:1939] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 3ef3a0f98fc5488b82cdfcba2669a697: Deleting consensus metadata
I20260811 18:53:09.816740 405 ts_tablet_manager.cc:1918] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:09.816835 405 log.cc:1196] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/593a4d1b01a94f49adaa7aec9c6d3b95
I20260811 18:53:09.817044 32063 catalog_manager.cc:4841] TS 3ef3a0f98fc5488b82cdfcba2669a697 (127.23.226.194:44939): tablet 593a4d1b01a94f49adaa7aec9c6d3b95 (table test-table [id=c516266802cb460caedecf620a35e07f]) successfully deleted
I20260811 18:53:09.817121 405 ts_tablet_manager.cc:1939] T 593a4d1b01a94f49adaa7aec9c6d3b95 P 622bfb5f26c6462dbb0328fc7b419cd0: Deleting consensus metadata
I20260811 18:53:09.817543 32063 catalog_manager.cc:4841] TS 622bfb5f26c6462dbb0328fc7b419cd0 (127.23.226.195:44191): tablet 593a4d1b01a94f49adaa7aec9c6d3b95 (table test-table [id=c516266802cb460caedecf620a35e07f]) successfully deleted
W20260811 18:53:09.819478 32060 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:33185 (error 108)
I20260811 18:53:09.819766 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 32390
I20260811 18:53:09.819953 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:09.819819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:33185 (local address 127.0.0.1:55908)
0811 18:53:09.819876 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:09.819914 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:33185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 18:53:09.822710 32060 catalog_manager.cc:4584] TS 98b1bef10a4540fba47ef949f8c418b9 (127.23.226.193:33185): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 593a4d1b01a94f49adaa7aec9c6d3b95: Network error: Client connection negotiation failed: client connection to 127.23.226.193:33185: connect: Connection refused (error 111)
I20260811 18:53:09.836723 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 32606
I20260811 18:53:09.845556 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 32039
2026-08-11T18:53:09Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (958 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 18:53:09.871934 24459 mini_oidc.cc:152] Starting JWKS server
I20260811 18:53:09.873095 24459 webserver.cc:460] Webserver started at https://127.0.0.1:46719/ using document root <none> and password file <none>
I20260811 18:53:09.873174 24459 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:53:09.873314 24459 webserver.cc:460] Webserver started at http://127.0.0.1:39011/ using document root <none> and password file <none>
2026-08-11T18:53:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:09Z Disabled control of system clock
I20260811 18:53:09.882207 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:38595
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:42835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:38595
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46719/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/testchainca.cert with env {}
W20260811 18:53:09.964969 419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:09.965232 419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:09.965273 419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:09.966470 419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:09.966535 419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:09.966557 419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:09.966578 419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:09.966614 419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:53:09.966645 419 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:53:09.966672 419 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46719/jwks.json
I20260811 18:53:09.968298 419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:38595
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:38595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46719/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:09.968576 419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:09.968806 419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:09.973767 428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.973767 433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:09.973800 429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:09.974079 419 server_base.cc:1034] running on GCE node
I20260811 18:53:09.974346 419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:09.974665 419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:09.975860 419 hybrid_clock.cc:648] HybridClock initialized: now 1786474389975846 us; error 45 us; skew 500 ppm
I20260811 18:53:09.977272 419 webserver.cc:460] Webserver started at http://127.23.226.254:41861/ using document root <none> and password file <none>
I20260811 18:53:09.977550 419 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:09.977631 419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:09.977783 419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:09.978950 419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "4bbce2cfeffd41428b652b5d45767526"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "5f7b67507ce92af76771d12312cb33fc"
server_key_iv: "f81b17908f3df3fc4699848e3b84bf53"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.979329 419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "4bbce2cfeffd41428b652b5d45767526"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "5f7b67507ce92af76771d12312cb33fc"
server_key_iv: "f81b17908f3df3fc4699848e3b84bf53"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.980756 419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:09.981694 442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:09.981887 419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:09.982002 419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "4bbce2cfeffd41428b652b5d45767526"
format_stamp: "Formatted at 2026-08-11 18:53:09 on dist-test-slave-68xk"
server_key: "5f7b67507ce92af76771d12312cb33fc"
server_key_iv: "f81b17908f3df3fc4699848e3b84bf53"
server_key_version: "encryptionkey@0"
I20260811 18:53:09.982081 419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:09.993544 419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:09.993875 419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:09.994032 419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:09.998188 419 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:38595
I20260811 18:53:09.998281 529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:38595 every 8 connection(s)
I20260811 18:53:09.998660 419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:09.999629 531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:10.002061 531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526: Bootstrap starting.
I20260811 18:53:10.002820 531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:10.003150 531 log.cc:824] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:10.003974 531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526: No bootstrap required, opened a new log
I20260811 18:53:10.005781 531 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbce2cfeffd41428b652b5d45767526" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38595 } }
I20260811 18:53:10.005930 531 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:10.005954 531 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bbce2cfeffd41428b652b5d45767526, State: Initialized, Role: FOLLOWER
I20260811 18:53:10.006138 531 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbce2cfeffd41428b652b5d45767526" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38595 } }
I20260811 18:53:10.006209 531 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:10.006232 531 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:10.006281 531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:10.006743 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 419
I20260811 18:53:10.006848 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:10.007053 24459 external_mini_cluster.cc:1428] Setting key 75514d7a56c300dd4d5bfb0938e119d6
I20260811 18:53:10.007155 531 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbce2cfeffd41428b652b5d45767526" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38595 } }
I20260811 18:53:10.007267 531 leader_election.cc:302] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bbce2cfeffd41428b652b5d45767526; no voters:
I20260811 18:53:10.007473 531 leader_election.cc:288] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:10.007588 534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:10.007706 534 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [term 1 LEADER]: Becoming Leader. State: Replica: 4bbce2cfeffd41428b652b5d45767526, State: Running, Role: LEADER
I20260811 18:53:10.007773 531 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:10.007809 534 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbce2cfeffd41428b652b5d45767526" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38595 } }
I20260811 18:53:10.008256 540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bbce2cfeffd41428b652b5d45767526. Latest consensus state: current_term: 1 leader_uuid: "4bbce2cfeffd41428b652b5d45767526" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbce2cfeffd41428b652b5d45767526" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38595 } } }
I20260811 18:53:10.008352 540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:10.008550 536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bbce2cfeffd41428b652b5d45767526" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bbce2cfeffd41428b652b5d45767526" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38595 } } }
I20260811 18:53:10.008620 536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:10.008633 553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:10.009184 553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:10.010777 553 catalog_manager.cc:1347] Generated new cluster ID: e396c710e14b490489af64964343c5be
I20260811 18:53:10.010839 553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:10.014071 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:10.007647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.23.226.254:38595)
0811 18:53:10.008019 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:10.008028 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:10.008061 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:53:10.008195 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:10.008203 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:10.008301 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:10.008857 (+ 556us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:10.008969 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.010604 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.011750 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.012380 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.012519 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.013315 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:10.013320 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:10.013320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:10.013544 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:10.013589 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:10.013605 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:10.013674 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:10.013752 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 18:53:10.013838 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":77,"threads_started":1}
I20260811 18:53:10.015298 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:10.017889 553 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:10.018626 553 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:10.023478 553 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bbce2cfeffd41428b652b5d45767526: Generated new TSK 0
I20260811 18:53:10.023650 553 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 18:53:10.058697 583 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 18:53:10.058851 583 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260811 18:53:10.059399 582 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:10.035128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:38595 (local address 127.0.0.1:49880)
0811 18:53:10.035368 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:10.035379 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:10.035451 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:10.035645 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:10.035646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:10.035648 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:53:10.035707 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:10.035709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.036346 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.036347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:10.037322 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:10.037325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.037754 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.037755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:10.037819 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.037844 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:53:10.058951 (+ 21107us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46719/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 18:53:10.059074 (+ 123us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.226.254:38595: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46719/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":150,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.23.226.254:38595: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46719/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 18:53:10.059773 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 419
I20260811 18:53:10.059794 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:10.035198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.23.226.254:38595)
0811 18:53:10.035261 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:10.035263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:10.035441 (+ 178us) server_negotiation.cc:407] Connection header received
0811 18:53:10.035549 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:10.035550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:10.035561 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:10.035619 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:53:10.035779 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.036250 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.037432 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.037649 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.037717 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.037985 (+ 268us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:53:10.058750 (+ 20765us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46719/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 18:53:10.059713 (+ 963us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49880: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46719/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":37}
2026-08-11T18:53:10Z chronyd exiting
I20260811 18:53:10.108250 24459 test_util.cc:175] -----------------------------------------------
I20260811 18:53:10.108374 24459 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786474364687722-24459-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (237 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 18:53:10.109244 24459 mini_oidc.cc:152] Starting JWKS server
I20260811 18:53:10.109968 24459 webserver.cc:460] Webserver started at https://127.0.0.1:35721/ using document root <none> and password file <none>
I20260811 18:53:10.110038 24459 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:53:10.110229 24459 webserver.cc:460] Webserver started at http://127.0.0.1:36345/ using document root <none> and password file <none>
2026-08-11T18:53:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:10Z Disabled control of system clock
I20260811 18:53:10.119186 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46651
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:46651
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35721/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/testchainca.cert with env {}
W20260811 18:53:10.201632 594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:10.201850 594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:10.201874 594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:10.203112 594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:10.203157 594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:10.203171 594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:10.203184 594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:10.203197 594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:53:10.203209 594 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:53:10.203222 594 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35721/jwks.json
I20260811 18:53:10.204749 594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:46651
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35721/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:10.204962 594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:10.205165 594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:10.210180 603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:10.210206 606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:10.210197 612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:10.210451 594 server_base.cc:1034] running on GCE node
I20260811 18:53:10.210695 594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:10.211025 594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:10.212199 594 hybrid_clock.cc:648] HybridClock initialized: now 1786474390212180 us; error 45 us; skew 500 ppm
I20260811 18:53:10.213524 594 webserver.cc:460] Webserver started at http://127.23.226.254:41315/ using document root <none> and password file <none>
I20260811 18:53:10.213797 594 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:10.213872 594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:10.214022 594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:10.215269 594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "b41f81be18174c17a0e69e81699b9e0b"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "9816490c8f8c9d12bb74f5e9c71ca9f5"
server_key_iv: "6641121ad33f4c50966868aa3d0c3c71"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.215644 594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "b41f81be18174c17a0e69e81699b9e0b"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "9816490c8f8c9d12bb74f5e9c71ca9f5"
server_key_iv: "6641121ad33f4c50966868aa3d0c3c71"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.217015 594 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 18:53:10.217836 622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:10.218032 594 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:10.218146 594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "b41f81be18174c17a0e69e81699b9e0b"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "9816490c8f8c9d12bb74f5e9c71ca9f5"
server_key_iv: "6641121ad33f4c50966868aa3d0c3c71"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.218225 594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:10.225603 594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:10.225885 594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:10.226032 594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:10.230084 594 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:46651
I20260811 18:53:10.230118 719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:46651 every 8 connection(s)
I20260811 18:53:10.230563 594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:10.231276 720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:10.233706 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 594
I20260811 18:53:10.233806 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:10.234000 24459 external_mini_cluster.cc:1428] Setting key b23c6326a5a6b738915edfc3ed3683df
I20260811 18:53:10.234269 720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b: Bootstrap starting.
I20260811 18:53:10.234951 720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:10.235260 720 log.cc:824] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:10.235946 720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b: No bootstrap required, opened a new log
I20260811 18:53:10.237741 720 raft_consensus.cc:348] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b41f81be18174c17a0e69e81699b9e0b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46651 } }
I20260811 18:53:10.237869 720 raft_consensus.cc:374] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:10.237891 720 raft_consensus.cc:729] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b41f81be18174c17a0e69e81699b9e0b, State: Initialized, Role: FOLLOWER
I20260811 18:53:10.238034 720 consensus_queue.cc:260] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b41f81be18174c17a0e69e81699b9e0b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46651 } }
I20260811 18:53:10.238137 720 raft_consensus.cc:388] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:10.238173 720 raft_consensus.cc:482] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:10.238221 720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:10.238929 720 raft_consensus.cc:504] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b41f81be18174c17a0e69e81699b9e0b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46651 } }
I20260811 18:53:10.239020 720 leader_election.cc:302] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b41f81be18174c17a0e69e81699b9e0b; no voters:
I20260811 18:53:10.239216 720 leader_election.cc:288] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:10.239398 731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:10.239503 720 sys_catalog.cc:564] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:10.239619 731 raft_consensus.cc:686] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [term 1 LEADER]: Becoming Leader. State: Replica: b41f81be18174c17a0e69e81699b9e0b, State: Running, Role: LEADER
I20260811 18:53:10.239706 723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:10.234514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34566 (local address 127.23.226.254:46651)
0811 18:53:10.234714 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:10.234724 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:10.234763 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:53:10.235287 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:10.235294 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:10.235397 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:10.235538 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:10.235796 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.236749 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.237542 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.238016 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.238154 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.238859 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:10.238863 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:10.238863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:10.239073 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:10.239120 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:10.239135 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:10.239198 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:10.239324 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 18:53:10.239413 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
I20260811 18:53:10.239759 731 consensus_queue.cc:237] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b41f81be18174c17a0e69e81699b9e0b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46651 } }
I20260811 18:53:10.240218 731 sys_catalog.cc:455] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b41f81be18174c17a0e69e81699b9e0b. Latest consensus state: current_term: 1 leader_uuid: "b41f81be18174c17a0e69e81699b9e0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b41f81be18174c17a0e69e81699b9e0b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46651 } } }
I20260811 18:53:10.240317 731 sys_catalog.cc:458] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:10.240236 730 sys_catalog.cc:455] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b41f81be18174c17a0e69e81699b9e0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b41f81be18174c17a0e69e81699b9e0b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46651 } } }
I20260811 18:53:10.240468 730 sys_catalog.cc:458] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:10.240689 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 18:53:10.242190 757 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:10.242244 757 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:10.242287 738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:10.242477 738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:10.243880 738 catalog_manager.cc:1347] Generated new cluster ID: c9c14f5129a2462f811642a035f099c6
I20260811 18:53:10.243935 738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:10.253453 738 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:10.253958 738 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:10.258052 738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b41f81be18174c17a0e69e81699b9e0b: Generated new TSK 0
I20260811 18:53:10.258261 738 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 18:53:10.281596 769 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 18:53:10.281708 769 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 18:53:10.282012 723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:10.267740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34576 (local address 127.23.226.254:46651)
0811 18:53:10.267811 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:10.267813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:10.267823 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:10.267859 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:10.267859 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:10.267871 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:10.267954 (+ 83us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:53:10.268075 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.268863 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.269614 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.269929 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.270001 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.270148 (+ 147us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:53:10.281782 (+ 11634us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 18:53:10.281939 (+ 157us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34576: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 18:53:10.282078 723 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34576: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 18:53:10.282097 768 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:10.267567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46651 (local address 127.0.0.1:34576)
0811 18:53:10.267712 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:10.267724 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:10.267781 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:10.267952 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:10.267952 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:10.267954 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:53:10.268009 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:10.268011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.268948 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.268949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:10.269533 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:10.269535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.270008 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.270009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:10.270050 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.270055 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:53:10.281887 (+ 11832us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 18:53:10.281989 (+ 102us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.226.254:46651: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35721/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":96,"threads_started":1}
I20260811 18:53:10.282462 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 594
2026-08-11T18:53:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (216 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 18:53:10.326215 24459 mini_oidc.cc:152] Starting JWKS server
I20260811 18:53:10.327028 24459 webserver.cc:460] Webserver started at https://127.0.0.1:35395/ using document root <none> and password file <none>
I20260811 18:53:10.327102 24459 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 18:53:10.327278 24459 webserver.cc:460] Webserver started at http://127.0.0.1:34525/ using document root <none> and password file <none>
2026-08-11T18:53:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:10Z Disabled control of system clock
I20260811 18:53:10.336755 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42219
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:41235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:42219
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35395/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 18:53:10.419659 776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:10.419889 776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:10.419914 776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:10.421084 776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:10.421125 776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:10.421139 776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:10.421151 776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:10.421164 776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:53:10.421176 776 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:53:10.421188 776 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35395/jwks.json
I20260811 18:53:10.422627 776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:42219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35395/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:10.422909 776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:10.423177 776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:10.428251 788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:10.428304 783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:10.428407 776 server_base.cc:1034] running on GCE node
W20260811 18:53:10.428258 782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:10.428720 776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:10.429055 776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:10.430291 776 hybrid_clock.cc:648] HybridClock initialized: now 1786474390430264 us; error 47 us; skew 500 ppm
I20260811 18:53:10.431794 776 webserver.cc:460] Webserver started at http://127.23.226.254:40433/ using document root <none> and password file <none>
I20260811 18:53:10.432070 776 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:10.432127 776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:10.432307 776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:10.433476 776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "cbd66836470541f6babcf0cff9e708e0"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "b1f77acc2ac4a2226ee67778ea3652b6"
server_key_iv: "e7054242c77a2358e291fab68ffc76ac"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.433844 776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "cbd66836470541f6babcf0cff9e708e0"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "b1f77acc2ac4a2226ee67778ea3652b6"
server_key_iv: "e7054242c77a2358e291fab68ffc76ac"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.435356 776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:10.436194 795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:10.436414 776 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:10.436504 776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "cbd66836470541f6babcf0cff9e708e0"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "b1f77acc2ac4a2226ee67778ea3652b6"
server_key_iv: "e7054242c77a2358e291fab68ffc76ac"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.436560 776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:10.449735 776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:10.450007 776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:10.450110 776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:10.454205 776 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:42219
I20260811 18:53:10.454247 872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:42219 every 8 connection(s)
I20260811 18:53:10.454650 776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:10.455416 874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:10.458182 874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0: Bootstrap starting.
I20260811 18:53:10.458879 874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:10.459195 874 log.cc:824] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:10.459983 874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0: No bootstrap required, opened a new log
I20260811 18:53:10.461621 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 776
I20260811 18:53:10.461723 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:10.461913 24459 external_mini_cluster.cc:1428] Setting key 9bdd50e600ee880844cc5d52c01c789c
I20260811 18:53:10.461802 874 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd66836470541f6babcf0cff9e708e0" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42219 } }
I20260811 18:53:10.461973 874 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:10.462020 874 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd66836470541f6babcf0cff9e708e0, State: Initialized, Role: FOLLOWER
I20260811 18:53:10.462184 874 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd66836470541f6babcf0cff9e708e0" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42219 } }
I20260811 18:53:10.462257 874 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:10.462302 874 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:10.462352 874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:10.463110 874 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd66836470541f6babcf0cff9e708e0" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42219 } }
I20260811 18:53:10.463223 874 leader_election.cc:302] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbd66836470541f6babcf0cff9e708e0; no voters:
I20260811 18:53:10.463416 874 leader_election.cc:288] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:10.463438 882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:10.463569 882 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [term 1 LEADER]: Becoming Leader. State: Replica: cbd66836470541f6babcf0cff9e708e0, State: Running, Role: LEADER
I20260811 18:53:10.463655 882 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd66836470541f6babcf0cff9e708e0" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42219 } }
I20260811 18:53:10.463689 874 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:10.464046 882 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbd66836470541f6babcf0cff9e708e0. Latest consensus state: current_term: 1 leader_uuid: "cbd66836470541f6babcf0cff9e708e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd66836470541f6babcf0cff9e708e0" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42219 } } }
I20260811 18:53:10.464119 882 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:10.465251 883 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbd66836470541f6babcf0cff9e708e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd66836470541f6babcf0cff9e708e0" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42219 } } }
I20260811 18:53:10.465477 883 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0 [sys.catalog]: This master's current role is: LEADER
W20260811 18:53:10.465798 910 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:10.466213 910 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:10.466323 891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:10.466562 891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:10.468240 891 catalog_manager.cc:1347] Generated new cluster ID: 625bf30ca0654da29dc644efca6919bb
I20260811 18:53:10.468298 891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:10.468784 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:10.462499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57752 (local address 127.23.226.254:42219)
0811 18:53:10.462712 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:10.462721 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:10.462755 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:53:10.462885 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:10.462893 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:10.462975 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:10.463143 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:10.463394 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.465335 (+ 1941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.466544 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.467174 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.467306 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.467989 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:10.467993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:10.467993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:10.468208 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:10.468252 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:10.468269 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:10.468341 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:10.468474 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 18:53:10.468556 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":83,"threads_started":1}
I20260811 18:53:10.474902 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:10.484503 891 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:10.485036 891 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:10.495548 891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbd66836470541f6babcf0cff9e708e0: Generated new TSK 0
I20260811 18:53:10.495762 891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:10.507066 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:10.503057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57754 (local address 127.23.226.254:42219)
0811 18:53:10.503104 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:10.503106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:10.503225 (+ 119us) server_negotiation.cc:407] Connection header received
0811 18:53:10.503315 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:10.503316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:10.503360 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:10.503440 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:53:10.503589 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.504098 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.504910 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.505128 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.505208 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.505411 (+ 203us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:53:10.506844 (+ 1433us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35395/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 18:53:10.506983 (+ 139us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57754: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35395/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 18:53:10.507133 880 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57754: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35395/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 18:53:10.507175 923 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:10.502995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42219 (local address 127.0.0.1:57754)
0811 18:53:10.503143 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:10.503154 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:10.503243 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:10.503442 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:10.503444 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:10.503446 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:53:10.503506 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:10.503508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.504193 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.504194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:10.504814 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:10.504816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.505218 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.505220 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:10.505283 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.505289 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:53:10.506953 (+ 1664us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35395/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 18:53:10.507066 (+ 113us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.226.254:42219: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35395/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
I20260811 18:53:10.507442 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 776
E20260811 18:53:10.523418 924 webserver.cc:533] Webserver: sslize failed:
E20260811 18:53:10.523499 924 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T18:53:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (227 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T18:53:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:10Z Disabled control of system clock
I20260811 18:53:10.562523 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:36599
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:42277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:36599
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/testchainca.cert with env {}
W20260811 18:53:10.645892 930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:10.646121 930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:10.646145 930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:10.647490 930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:10.647536 930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:10.647549 930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:10.647562 930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:10.647574 930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 18:53:10.647588 930 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 18:53:10.647598 930 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 18:53:10.649185 930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:36599
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:36599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:10.649468 930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:10.649705 930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:10.656665 941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:10.656741 936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:10.656641 937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:10.656881 930 server_base.cc:1034] running on GCE node
I20260811 18:53:10.657119 930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:10.657416 930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:10.658564 930 hybrid_clock.cc:648] HybridClock initialized: now 1786474390658534 us; error 46 us; skew 500 ppm
I20260811 18:53:10.664460 930 webserver.cc:460] Webserver started at http://127.23.226.254:45579/ using document root <none> and password file <none>
I20260811 18:53:10.664757 930 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:10.664809 930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:10.664984 930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:10.666132 930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "8cdce15cbd9048fd93f89db697c6123d"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "85f173582e1f69017eea8fbac5f921e4"
server_key_iv: "72a5f5bcc6fd84f01ace5ac7770fc64b"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.666544 930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "8cdce15cbd9048fd93f89db697c6123d"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "85f173582e1f69017eea8fbac5f921e4"
server_key_iv: "72a5f5bcc6fd84f01ace5ac7770fc64b"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.667896 930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:10.668713 951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:10.668893 930 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:53:10.668982 930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "8cdce15cbd9048fd93f89db697c6123d"
format_stamp: "Formatted at 2026-08-11 18:53:10 on dist-test-slave-68xk"
server_key: "85f173582e1f69017eea8fbac5f921e4"
server_key_iv: "72a5f5bcc6fd84f01ace5ac7770fc64b"
server_key_version: "encryptionkey@0"
I20260811 18:53:10.669034 930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:10.680090 930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:10.680361 930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:10.680469 930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:10.684557 930 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:36599
I20260811 18:53:10.684619 1026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:36599 every 8 connection(s)
I20260811 18:53:10.684986 930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:10.686056 1027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:10.687546 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 930
I20260811 18:53:10.687630 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:10.687808 24459 external_mini_cluster.cc:1428] Setting key afdb59720435432b54c0a590efd30bce
I20260811 18:53:10.688984 1027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d: Bootstrap starting.
I20260811 18:53:10.689741 1027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:10.690079 1027 log.cc:824] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:10.690899 1027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d: No bootstrap required, opened a new log
I20260811 18:53:10.693078 1027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cdce15cbd9048fd93f89db697c6123d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36599 } }
I20260811 18:53:10.693212 1027 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:10.693244 1027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cdce15cbd9048fd93f89db697c6123d, State: Initialized, Role: FOLLOWER
I20260811 18:53:10.693398 1027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cdce15cbd9048fd93f89db697c6123d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36599 } }
I20260811 18:53:10.693508 1027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:10.693544 1027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:10.693593 1027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:10.694339 1033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:10.688380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.23.226.254:36599)
0811 18:53:10.688639 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:10.688648 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:10.688682 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:53:10.689228 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:10.689237 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:10.689322 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:10.689492 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:10.689660 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.691060 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.691940 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.692596 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.692765 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.693532 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:10.693537 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:10.693538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:10.693766 (+ 228us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:10.693809 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:10.693823 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:10.693897 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:10.694019 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 18:53:10.694105 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":111,"threads_started":1}
I20260811 18:53:10.694375 1027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cdce15cbd9048fd93f89db697c6123d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36599 } }
I20260811 18:53:10.694494 1027 leader_election.cc:302] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cdce15cbd9048fd93f89db697c6123d; no voters:
I20260811 18:53:10.694658 1027 leader_election.cc:288] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:10.694682 1035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:10.694917 1035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [term 1 LEADER]: Becoming Leader. State: Replica: 8cdce15cbd9048fd93f89db697c6123d, State: Running, Role: LEADER
I20260811 18:53:10.694934 1027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:10.695065 1035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cdce15cbd9048fd93f89db697c6123d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36599 } }
I20260811 18:53:10.695429 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:53:10.695423 1040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cdce15cbd9048fd93f89db697c6123d. Latest consensus state: current_term: 1 leader_uuid: "8cdce15cbd9048fd93f89db697c6123d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cdce15cbd9048fd93f89db697c6123d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36599 } } }
I20260811 18:53:10.695493 1040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:10.695710 1044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:10.696451 1038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cdce15cbd9048fd93f89db697c6123d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cdce15cbd9048fd93f89db697c6123d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36599 } } }
I20260811 18:53:10.696584 1038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:10.696496 1044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:10.698159 1044 catalog_manager.cc:1347] Generated new cluster ID: d73c6e3fd8fd4fa58f21022588ce8a2a
I20260811 18:53:10.698212 1044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:10.719820 1044 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:10.720395 1044 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:10.725260 1044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cdce15cbd9048fd93f89db697c6123d: Generated new TSK 0
I20260811 18:53:10.725450 1044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:11.583855 1033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:10.734115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.23.226.254:36599)
0811 18:53:10.734184 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:10.734186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:10.734319 (+ 133us) server_negotiation.cc:407] Connection header received
0811 18:53:10.734398 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:10.734398 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:10.734447 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:10.734518 (+ 71us) server_negotiation.cc:226] Negotiated authn=JWT
0811 18:53:10.734678 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.735163 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.736336 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.736517 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.736568 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.736764 (+ 196us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 18:53:11.583616 (+846852us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 18:53:11.583792 (+ 176us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42088: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 18:53:11.583968 1033 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42088: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 18:53:11.584208 1078 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:10.734038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:36599 (local address 127.0.0.1:42088)
0811 18:53:10.734243 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:10.734255 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:10.734327 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:10.734537 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:10.734539 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:10.734541 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 18:53:10.734607 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:10.734609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.735266 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.735267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:10.736252 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:10.736256 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:10.736596 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:10.736597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:10.736662 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:10.736668 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 18:53:11.583798 (+847130us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 18:53:11.583970 (+ 172us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.23.226.254:36599: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":117,"threads_started":1}
I20260811 18:53:11.584625 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 930
2026-08-11T18:53:11Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1056 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (94 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (93 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:11 dist-test-slave-68xk krb5kdc[1099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:11 dist-test-slave-68xk krb5kdc[1099](info): set up 2 sockets
Aug 11 18:53:11 dist-test-slave-68xk krb5kdc[1099](info): commencing operation
krb5kdc: starting...
W20260811 18:53:13.030435 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:53:13.157007 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:38819
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:38819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:13.239969 1117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:13.240172 1117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:13.240195 1117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:13.241312 1117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:13.241350 1117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:13.241364 1117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:13.241377 1117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:13.241390 1117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:13.242944 1117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:38819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:38819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:13.243145 1117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:13.243309 1117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:13.248039 1123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:13.248070 1130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:13.248085 1124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:13.248128 1117 server_base.cc:1034] running on GCE node
I20260811 18:53:13.248519 1117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:13.248862 1117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:13.250025 1117 hybrid_clock.cc:648] HybridClock initialized: now 1786474393250007 us; error 38 us; skew 500 ppm
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.252627 1117 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:53:13.253116 1117 webserver.cc:460] Webserver started at http://127.23.226.254:34275/ using document root <none> and password file <none>
I20260811 18:53:13.253387 1117 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:13.253456 1117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:13.253604 1117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:13.254705 1117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "7b4656beb3024c079931ca91b47d0f6d"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "2153c6efb8b10ab3b42d89f3ec59f767"
server_key_iv: "4424bedec85fb19596fa0d1a313c3bcf"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.255086 1117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "7b4656beb3024c079931ca91b47d0f6d"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "2153c6efb8b10ab3b42d89f3ec59f767"
server_key_iv: "4424bedec85fb19596fa0d1a313c3bcf"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.256436 1117 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:13.257179 1144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.257352 1117 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:13.257462 1117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "7b4656beb3024c079931ca91b47d0f6d"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "2153c6efb8b10ab3b42d89f3ec59f767"
server_key_iv: "4424bedec85fb19596fa0d1a313c3bcf"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.257535 1117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:13.268198 1117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:13.270176 1117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:13.270357 1117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:13.274677 1117 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:38819
I20260811 18:53:13.274719 1223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:38819 every 8 connection(s)
I20260811 18:53:13.275091 1117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:13.275985 1225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:13.278342 1225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d: Bootstrap starting.
I20260811 18:53:13.279019 1225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:13.279371 1225 log.cc:824] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:13.280156 1225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d: No bootstrap required, opened a new log
I20260811 18:53:13.281854 1225 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b4656beb3024c079931ca91b47d0f6d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38819 } }
I20260811 18:53:13.281996 1225 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:13.282045 1225 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b4656beb3024c079931ca91b47d0f6d, State: Initialized, Role: FOLLOWER
I20260811 18:53:13.282248 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 1117
I20260811 18:53:13.282222 1225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b4656beb3024c079931ca91b47d0f6d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38819 } }
I20260811 18:53:13.282310 1225 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:13.282347 1225 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:13.282352 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:13.282403 1225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:13.282584 24459 external_mini_cluster.cc:1428] Setting key 0b79ecc5929b20999e07a3d9c673dd4d
I20260811 18:53:13.283170 1225 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b4656beb3024c079931ca91b47d0f6d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38819 } }
I20260811 18:53:13.283381 1225 leader_election.cc:302] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b4656beb3024c079931ca91b47d0f6d; no voters:
I20260811 18:53:13.283556 1225 leader_election.cc:288] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:13.283790 1235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:13.283893 1225 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:13.283980 1235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [term 1 LEADER]: Becoming Leader. State: Replica: 7b4656beb3024c079931ca91b47d0f6d, State: Running, Role: LEADER
I20260811 18:53:13.284076 1235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b4656beb3024c079931ca91b47d0f6d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38819 } }
I20260811 18:53:13.284456 1235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b4656beb3024c079931ca91b47d0f6d. Latest consensus state: current_term: 1 leader_uuid: "7b4656beb3024c079931ca91b47d0f6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b4656beb3024c079931ca91b47d0f6d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38819 } } }
I20260811 18:53:13.284464 1236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b4656beb3024c079931ca91b47d0f6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b4656beb3024c079931ca91b47d0f6d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 38819 } } }
I20260811 18:53:13.284627 1235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:13.284636 1236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:13.284914 1248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:13.285844 1248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:13.287664 1248 catalog_manager.cc:1347] Generated new cluster ID: 3910c54cef8b4fd79a11208045e97c65
I20260811 18:53:13.287729 1248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:13.295339 1234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.283117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32966 (local address 127.23.226.254:38819)
0811 18:53:13.283353 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.283361 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.283388 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:53:13.283513 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.283521 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.283579 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.283738 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.284597 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.286342 (+ 1745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.287378 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.287967 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.288078 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.290946 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:13.290951 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:13.290951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:13.290963 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:13.293610 (+ 2647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.294006 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.294010 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.294010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.294132 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.294348 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.294349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.294350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.294711 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:13.294874 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:13.294970 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 18:53:13.295115 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":134,"threads_started":1}
I20260811 18:53:13.298308 1248 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:13.298856 1248 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:13.308436 1248 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b4656beb3024c079931ca91b47d0f6d: Generated new TSK 0
I20260811 18:53:13.308641 1248 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:53:13.341441 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:38819
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:13.425261 1266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:13.425467 1266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:13.425491 1266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:13.426640 1266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:13.426682 1266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:13.426709 1266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:13.428143 1266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:13.428342 1266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:13.428524 1266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:13.433583 1274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:13.433557 1273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:13.433557 1278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:13.433825 1266 server_base.cc:1034] running on GCE node
I20260811 18:53:13.434067 1266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:13.434324 1266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:13.435495 1266 hybrid_clock.cc:648] HybridClock initialized: now 1786474393435498 us; error 67 us; skew 500 ppm
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.438232 1266 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:53:13.438789 1266 webserver.cc:460] Webserver started at http://127.23.226.193:46449/ using document root <none> and password file <none>
I20260811 18:53:13.439049 1266 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:13.439124 1266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:13.439284 1266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:13.440366 1266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "1fdd302be8d040218576f9890b632277"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "7730ae0ca835b5ff2e1bf181448c2157"
server_key_iv: "092cd3a8b4516eda3805df8fec401fc8"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.440742 1266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "1fdd302be8d040218576f9890b632277"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "7730ae0ca835b5ff2e1bf181448c2157"
server_key_iv: "092cd3a8b4516eda3805df8fec401fc8"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.442274 1266 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:13.443171 1287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.443352 1266 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:13.443464 1266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "1fdd302be8d040218576f9890b632277"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "7730ae0ca835b5ff2e1bf181448c2157"
server_key_iv: "092cd3a8b4516eda3805df8fec401fc8"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.443542 1266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:13.456804 1266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:13.459048 1266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:13.459213 1266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:13.459470 1266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:13.459789 1266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:13.459844 1266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.459887 1266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:13.459911 1266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.465979 1266 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:39559
I20260811 18:53:13.466086 1473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:39559 every 8 connection(s)
I20260811 18:53:13.466394 1266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:13.467146 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 1266
I20260811 18:53:13.467255 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:13.467466 24459 external_mini_cluster.cc:1428] Setting key 5d1a8426821f9fd50431dbab6ea60b7d
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
I20260811 18:53:13.477555 1234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.467292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:48045 (local address 127.23.226.254:38819)
0811 18:53:13.467347 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.467349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.467590 (+ 241us) server_negotiation.cc:407] Connection header received
0811 18:53:13.468773 (+ 1183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.468774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.468797 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.468851 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.469514 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.470481 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.471760 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.471962 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.472026 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.474550 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:13.474551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:13.474552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:13.474560 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:13.476054 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.476523 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.476524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.476525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.476593 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.476862 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.476863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.476863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.476987 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:13.477066 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:13.477374 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 18:53:13.477465 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:53:13.477746 1479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.467231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:38819 (local address 127.23.226.193:48045)
0811 18:53:13.467434 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:13.467481 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:13.468657 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:13.468929 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:13.468933 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:13.469214 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:13.469405 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:13.469411 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.470569 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.470571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:13.471657 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:13.471661 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.472055 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.472057 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:13.472207 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.472716 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:13.472727 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:13.474401 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:13.476181 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:13.476189 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:13.476191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:13.476438 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:13.476671 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:13.476672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:13.476672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:13.476790 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:13.477071 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:13.477079 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:13.477228 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 18:53:13.477335 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 18:53:13.477499 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":89,"threads_started":1}
I20260811 18:53:13.478399 1476 heartbeater.cc:347] Connected to a master server at 127.23.226.254:38819
I20260811 18:53:13.478561 1476 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:13.478753 1476 heartbeater.cc:511] Master 127.23.226.254:38819 requested a full tablet report, sending...
I20260811 18:53:13.479362 1168 ts_manager.cc:194] Registered new tserver with Master: 1fdd302be8d040218576f9890b632277 (127.23.226.193:39559)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
I20260811 18:53:13.480154 1168 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:48045
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:53:13.497206 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:38819
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:13.585734 1486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:13.585961 1486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:13.585988 1486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:13.587332 1486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:13.587378 1486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:13.587409 1486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:13.589013 1486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:13.589233 1486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:13.589437 1486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:53:13.595083 1486 server_base.cc:1034] running on GCE node
W20260811 18:53:13.595049 1493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:13.595170 1492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:13.595043 1495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:13.595603 1486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:13.595875 1486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:13.597052 1486 hybrid_clock.cc:648] HybridClock initialized: now 1786474393597042 us; error 33 us; skew 500 ppm
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.600014 1486 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:53:13.600586 1486 webserver.cc:460] Webserver started at http://127.23.226.194:35825/ using document root <none> and password file <none>
I20260811 18:53:13.600843 1486 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:13.600914 1486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:13.601078 1486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:13.602160 1486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "1e52c40a1cb74daf97628460e8f3f990"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "da92608f573959190007d912cc4fd403"
server_key_iv: "b53da4468f1644c9141122d55e435822"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.602583 1486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "1e52c40a1cb74daf97628460e8f3f990"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "da92608f573959190007d912cc4fd403"
server_key_iv: "b53da4468f1644c9141122d55e435822"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.603974 1486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:13.604809 1503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.604987 1486 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:53:13.605109 1486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "1e52c40a1cb74daf97628460e8f3f990"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "da92608f573959190007d912cc4fd403"
server_key_iv: "b53da4468f1644c9141122d55e435822"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.605194 1486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:13.626297 1486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:13.628454 1486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:13.628633 1486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:13.628896 1486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:13.629261 1486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:13.629328 1486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.629365 1486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:13.629415 1486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.635784 1486 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:38759
I20260811 18:53:13.635854 1684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:38759 every 8 connection(s)
I20260811 18:53:13.636224 1486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:13.644965 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 1486
I20260811 18:53:13.645092 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:13.645273 24459 external_mini_cluster.cc:1428] Setting key f0b84aa57d1373332a2df338e665fe29
I20260811 18:53:13.646692 1234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.637006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:52525 (local address 127.23.226.254:38819)
0811 18:53:13.637101 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.637103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.637298 (+ 195us) server_negotiation.cc:407] Connection header received
0811 18:53:13.638303 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.638305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.638317 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.638379 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.639026 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.639537 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.640552 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.640759 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.640838 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.643085 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:13.643086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:13.643087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:13.643095 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:13.644953 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.645502 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.645504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.645504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.645595 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.645972 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.645973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.645974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.646113 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:13.646170 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:13.646554 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 18:53:13.646627 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:53:13.647042 1693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.636961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:38819 (local address 127.23.226.194:52525)
0811 18:53:13.637140 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:13.637179 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:13.638177 (+ 998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:13.638468 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:13.638472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:13.638729 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:13.638920 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:13.638925 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.639640 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.639641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:13.640450 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:13.640453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.640859 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.640860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:13.640983 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.641524 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:13.641534 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:13.642970 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:13.645096 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:13.645103 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:13.645106 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:13.645415 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:13.645677 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:13.645678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:13.645679 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:13.645828 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:13.646168 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:13.646176 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:13.646360 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 18:53:13.646532 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 18:53:13.646726 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
I20260811 18:53:13.647645 1688 heartbeater.cc:347] Connected to a master server at 127.23.226.254:38819
I20260811 18:53:13.647782 1688 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:13.647987 1688 heartbeater.cc:511] Master 127.23.226.254:38819 requested a full tablet report, sending...
I20260811 18:53:13.648352 1168 ts_manager.cc:194] Registered new tserver with Master: 1e52c40a1cb74daf97628460e8f3f990 (127.23.226.194:38759)
I20260811 18:53:13.648892 1168 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:52525
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:53:13.675987 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:38819
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:13.769168 1697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:13.769399 1697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:13.769438 1697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:13.770648 1697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:13.770709 1697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:13.770759 1697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:13.772804 1697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:38819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:13.773118 1697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:13.773394 1697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:13.778857 1716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:13.778868 1710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:13.778874 1714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:13.779290 1697 server_base.cc:1034] running on GCE node
I20260811 18:53:13.779616 1697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:13.779899 1697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:13.781083 1697 hybrid_clock.cc:648] HybridClock initialized: now 1786474393781066 us; error 32 us; skew 500 ppm
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.784567 1697 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:53:13.785156 1697 webserver.cc:460] Webserver started at http://127.23.226.195:38137/ using document root <none> and password file <none>
I20260811 18:53:13.785458 1697 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:13.785521 1697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:13.785665 1697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:13.786846 1697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "b8df2c65a03b4e0ca0713a0a308de2fa"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "5a7f67a27224084e13058ea3fb48834e"
server_key_iv: "2545d7e8c532a34318b8513fae4be063"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.787240 1697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "b8df2c65a03b4e0ca0713a0a308de2fa"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "5a7f67a27224084e13058ea3fb48834e"
server_key_iv: "2545d7e8c532a34318b8513fae4be063"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.788564 1697 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:13.789302 1725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.789479 1697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:13.789589 1697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "b8df2c65a03b4e0ca0713a0a308de2fa"
format_stamp: "Formatted at 2026-08-11 18:53:13 on dist-test-slave-68xk"
server_key: "5a7f67a27224084e13058ea3fb48834e"
server_key_iv: "2545d7e8c532a34318b8513fae4be063"
server_key_version: "encryptionkey@0"
I20260811 18:53:13.789664 1697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:13.806702 1697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:13.808962 1697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:13.809147 1697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:13.809384 1697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:13.809711 1697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:13.809774 1697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.809818 1697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:13.809845 1697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:13.815722 1697 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:45449
I20260811 18:53:13.815826 1917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:45449 every 8 connection(s)
I20260811 18:53:13.816138 1697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:13.822166 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 1697
I20260811 18:53:13.822273 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:13.822500 24459 external_mini_cluster.cc:1428] Setting key 70554d88580e2264392fa489d162a964
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:13.826056 1234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.816893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:35609 (local address 127.23.226.254:38819)
0811 18:53:13.816939 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.816941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.817201 (+ 260us) server_negotiation.cc:407] Connection header received
0811 18:53:13.818205 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.818206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.818221 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.818273 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.818998 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.819501 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.820522 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.820725 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.820804 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.823055 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:13.823057 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:13.823057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:13.823066 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:13.824617 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.825059 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.825060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.825061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.825127 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.825395 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.825396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.825397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.825519 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:13.825598 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:13.825883 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 18:53:13.825967 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:53:13.826238 1920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.816883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:38819 (local address 127.23.226.195:35609)
0811 18:53:13.817072 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:13.817108 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:13.818074 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:13.818343 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:13.818347 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:13.818691 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:13.818885 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:13.818890 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.819604 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.819605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:13.820411 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:13.820413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.820813 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.820814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:13.820946 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.821409 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:13.821418 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:13.822947 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:13.824727 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:13.824735 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:13.824737 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:13.824967 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:13.825202 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:13.825203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:13.825203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:13.825318 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:13.825589 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:13.825596 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:13.825742 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 18:53:13.825847 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 18:53:13.826006 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":95,"threads_started":1}
I20260811 18:53:13.826769 1918 heartbeater.cc:347] Connected to a master server at 127.23.226.254:38819
I20260811 18:53:13.826853 1918 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:13.827051 1918 heartbeater.cc:511] Master 127.23.226.254:38819 requested a full tablet report, sending...
I20260811 18:53:13.827421 1168 ts_manager.cc:194] Registered new tserver with Master: b8df2c65a03b4e0ca0713a0a308de2fa (127.23.226.195:45449)
I20260811 18:53:13.827808 1168 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:35609
I20260811 18:53:13.834259 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/test-admin.keytab.
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.851966 24459 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 18:53:13.853652 1931 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:13.852819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54532 (local address 127.23.226.193:39559)
0811 18:53:13.853011 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.853016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.853025 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:13.853050 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.853052 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.853066 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.853177 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.853557 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54532: BlockingRecv error: recv got EOF from 127.0.0.1:54532 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":89,"threads_started":1}
W20260811 18:53:13.853773 24459 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5cc' of type FILE
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.854862 24459 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.855791 24459 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:53:13.864151 1931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.856405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54542 (local address 127.23.226.193:39559)
0811 18:53:13.856470 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.856473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.856553 (+ 80us) server_negotiation.cc:407] Connection header received
0811 18:53:13.856649 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.856649 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.856661 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.856713 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.857115 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.857860 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.858677 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.859021 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.859106 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.861420 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:13.861428 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:13.861429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:13.861436 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:13.862945 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.863304 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.863308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.863308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.863369 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.863577 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.863578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.863579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.863726 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:13.863911 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:13.863957 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 18:53:13.864036 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 18:53:13.866463 1931 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:13.865669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54548 (local address 127.23.226.193:39559)
0811 18:53:13.865737 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.865739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.865747 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:53:13.865797 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.865797 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.865806 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.865849 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.866360 (+ 511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54548: BlockingRecv error: recv got EOF from 127.0.0.1:54548 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 18:53:13.866588 24459 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5cc' of type FILE
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.867836 24459 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.868788 24459 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:53:13.876349 1931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.869395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54560 (local address 127.23.226.193:39559)
0811 18:53:13.869457 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.869459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.869500 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:53:13.869578 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.869579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.869589 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.869659 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.870037 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.870610 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.871320 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.871533 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.871612 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.873866 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:13.873868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:13.873868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:13.873875 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:13.875286 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.875678 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.875679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.875679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.875732 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.875916 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.875917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.875917 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.876007 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:13.876078 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:13.876205 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 18:53:13.876285 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 18:53:13.878008 1931 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:13.877403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54562 (local address 127.23.226.193:39559)
0811 18:53:13.877460 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.877463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.877506 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:53:13.877576 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.877577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.877586 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.877650 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.877939 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54562: BlockingRecv error: recv got EOF from 127.0.0.1:54562 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 18:53:13.878274 24459 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786474364687722-24459-0/krb5kdc/krb5cc)
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.879364 24459 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:13.880303 24459 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.193@KRBTEST.COM
I20260811 18:53:13.887806 1931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:13.880859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54570 (local address 127.23.226.193:39559)
0811 18:53:13.880925 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:13.880926 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:13.880936 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:13.881009 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:13.881010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:13.881018 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:13.881065 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:13.881484 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.881931 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.882748 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:13.882924 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:13.882977 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:13.885185 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:13.885186 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:13.885187 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:13.885195 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:13.886710 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.887068 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.887069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.887069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.887122 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:13.887305 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:13.887306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:13.887306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:13.887405 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:13.887496 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:13.887580 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 18:53:13.887640 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:53:13.888581 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 1266
I20260811 18:53:13.901265 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 1486
I20260811 18:53:13.924129 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 1697
I20260811 18:53:13.936925 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 1117
2026-08-11T18:53:13Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2163 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1950](info): set up 2 sockets
Aug 11 18:53:13 dist-test-slave-68xk krb5kdc[1950](info): commencing operation
krb5kdc: starting...
W20260811 18:53:15.204753 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:15 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:15Z Disabled control of system clock
WARNING: no policy specified for oryx/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.254.keytab.
Entry for principal oryx/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.254.keytab.
I20260811 18:53:15.329586 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41651
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.254.keytab
--principal=oryx/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:41651
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:15.412137 1970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:15.412406 1970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:15.412444 1970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:15.413590 1970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:15.413662 1970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:15.413688 1970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:15.413708 1970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:15.413748 1970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:15.415337 1970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:41651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.254.keytab
--principal=oryx/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:15.415625 1970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:15.415856 1970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:15.420994 1984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:15.420975 1977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:15.421061 1970 server_base.cc:1034] running on GCE node
W20260811 18:53:15.420975 1981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:15.421497 1970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:15.421756 1970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:15.422902 1970 hybrid_clock.cc:648] HybridClock initialized: now 1786474395422876 us; error 42 us; skew 500 ppm
Aug 11 18:53:15 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:15.425621 1970 init.cc:377] Logged in from keytab as oryx/127.23.226.254@KRBTEST.COM (short username oryx)
I20260811 18:53:15.426105 1970 webserver.cc:460] Webserver started at http://127.23.226.254:41873/ using document root <none> and password file <none>
I20260811 18:53:15.426371 1970 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:15.426463 1970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:15.426635 1970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:15.427780 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "31f61ea6c86349e0b4347eca8244742d"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "19fbe182a9b23addf389b2b03fb9330b"
server_key_iv: "87c73ec2574ce775a50d3af75acd0a9d"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.428165 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "31f61ea6c86349e0b4347eca8244742d"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "19fbe182a9b23addf389b2b03fb9330b"
server_key_iv: "87c73ec2574ce775a50d3af75acd0a9d"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.429504 1970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:15.430284 2001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:15.430516 1970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:15.430619 1970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "31f61ea6c86349e0b4347eca8244742d"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "19fbe182a9b23addf389b2b03fb9330b"
server_key_iv: "87c73ec2574ce775a50d3af75acd0a9d"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.430721 1970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:15.443753 1970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:15.446012 1970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:15.446208 1970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:15.450176 1970 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:41651
I20260811 18:53:15.450233 2083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:41651 every 8 connection(s)
I20260811 18:53:15.450645 1970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:15.451712 2084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:15.454012 2084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: Bootstrap starting.
I20260811 18:53:15.454720 2084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:15.454946 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 1970
I20260811 18:53:15.455022 2084 log.cc:824] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:15.455068 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:15.455260 24459 external_mini_cluster.cc:1428] Setting key 33d1cba8839810f7d9a3989a15931921
I20260811 18:53:15.455955 2084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: No bootstrap required, opened a new log
I20260811 18:53:15.458331 2084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } }
I20260811 18:53:15.458550 2084 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:15.458606 2084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f61ea6c86349e0b4347eca8244742d, State: Initialized, Role: FOLLOWER
I20260811 18:53:15.458750 2084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } }
I20260811 18:53:15.458851 2084 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:15.458892 2084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:15.458943 2084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:15.459501 2084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } }
I20260811 18:53:15.459630 2084 leader_election.cc:302] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31f61ea6c86349e0b4347eca8244742d; no voters:
I20260811 18:53:15.459831 2084 leader_election.cc:288] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:15.459882 2091 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:15.460073 2091 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 1 LEADER]: Becoming Leader. State: Replica: 31f61ea6c86349e0b4347eca8244742d, State: Running, Role: LEADER
I20260811 18:53:15.460137 2084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:15.460289 2091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } }
I20260811 18:53:15.460697 2091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31f61ea6c86349e0b4347eca8244742d. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } }
I20260811 18:53:15.460706 2094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } }
I20260811 18:53:15.460901 2094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:15.461139 2091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:15.461321 2105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:15.461894 2105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 18:53:15 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:15.463614 2105 catalog_manager.cc:1347] Generated new cluster ID: 8c2d940235c34ecd8de7a3c49e12889c
I20260811 18:53:15.463711 2105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:15.466949 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:15.455844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53844 (local address 127.23.226.254:41651)
0811 18:53:15.456051 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:15.456062 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:15.456094 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:53:15.456525 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:15.456531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:15.456578 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:15.456731 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:15.457389 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.458267 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.459320 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.459856 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.460530 (+ 674us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:15.463092 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:15.463097 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:15.463098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:15.463110 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:15.465218 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:15.465669 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:15.465673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:15.465673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:15.465771 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:15.466005 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:15.466006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:15.466007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:15.466250 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:15.466420 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:15.466593 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 18:53:15.466737 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260811 18:53:15.476068 2105 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:15.476761 2105 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:15.496955 2105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: Generated new TSK 0
I20260811 18:53:15.497196 2105 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab.
Entry for principal oryx/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab.
I20260811 18:53:15.529906 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41651
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab
--principal=oryx/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:15.615362 2122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:15.615599 2122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:15.615638 2122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:15.616817 2122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:15.616885 2122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:15.616930 2122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:15.618522 2122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab
--principal=oryx/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:15.618815 2122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:15.619056 2122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:15.624281 2132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:15.624426 2122 server_base.cc:1034] running on GCE node
W20260811 18:53:15.624284 2135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:15.624307 2133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:15.624750 2122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:15.625013 2122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:15.626210 2122 hybrid_clock.cc:648] HybridClock initialized: now 1786474395626195 us; error 28 us; skew 500 ppm
Aug 11 18:53:15 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:15.629180 2122 init.cc:377] Logged in from keytab as oryx/127.23.226.193@KRBTEST.COM (short username oryx)
I20260811 18:53:15.629638 2122 webserver.cc:460] Webserver started at http://127.23.226.193:38487/ using document root <none> and password file <none>
I20260811 18:53:15.629850 2122 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:15.629895 2122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:15.629992 2122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:15.631194 2122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "7318cee0f47143acaf4a37c441d84ee2"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "4bb78dfad2c8127f62c29aff1ef0114f"
server_key_iv: "bd0dfb686029493c227c355f72792d9d"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.631529 2122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "7318cee0f47143acaf4a37c441d84ee2"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "4bb78dfad2c8127f62c29aff1ef0114f"
server_key_iv: "bd0dfb686029493c227c355f72792d9d"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.632941 2122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:15.633826 2144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:15.634037 2122 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:15.634155 2122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "7318cee0f47143acaf4a37c441d84ee2"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "4bb78dfad2c8127f62c29aff1ef0114f"
server_key_iv: "bd0dfb686029493c227c355f72792d9d"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.634238 2122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:15.658541 2122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:15.660806 2122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:15.660923 2122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:15.661154 2122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:15.661512 2122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:15.661569 2122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:15.661604 2122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:15.661635 2122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:15.667654 2122 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:44615
I20260811 18:53:15.667769 2327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:44615 every 8 connection(s)
I20260811 18:53:15.668073 2122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:15.676118 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 2122
I20260811 18:53:15.676205 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:15.676522 24459 external_mini_cluster.cc:1428] Setting key 619da7d0f8e2385548e8b0d534da3b65
Aug 11 18:53:15 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:15.681568 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:15.668849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:40733 (local address 127.23.226.254:41651)
0811 18:53:15.668941 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:15.668944 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:15.669120 (+ 176us) server_negotiation.cc:407] Connection header received
0811 18:53:15.669623 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:15.669625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:15.669635 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:15.669686 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:15.670712 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.671214 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.672162 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.672389 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.672457 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:15.678296 (+ 5839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:15.678299 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:15.678299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:15.678307 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:15.679947 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:15.680506 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:15.680508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:15.680508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:15.680570 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:15.680868 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:15.680869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:15.680869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:15.680983 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:15.681040 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:15.681409 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 18:53:15.681497 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:53:15.681887 2330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:15.668796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:40733)
0811 18:53:15.668990 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:15.669027 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:15.669517 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:15.669752 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:15.669755 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:15.670336 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:15.670604 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:15.670610 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.671297 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.671298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:15.672065 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:15.672066 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.672473 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.672474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:15.672574 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:15.676695 (+ 4121us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:15.676705 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:15.678188 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:15.680059 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:15.680075 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:15.680078 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:15.680413 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:15.680640 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:15.680641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:15.680642 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:15.680798 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:15.681053 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:15.681060 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:15.681249 (+ 189us) client_negotiation.cc:769] Sending connection context
0811 18:53:15.681370 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 18:53:15.681573 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":95,"threads_started":1}
I20260811 18:53:15.682520 2328 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41651
I20260811 18:53:15.682618 2328 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:15.682832 2328 heartbeater.cc:511] Master 127.23.226.254:41651 requested a full tablet report, sending...
I20260811 18:53:15.683491 2033 ts_manager.cc:194] Registered new tserver with Master: 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615)
I20260811 18:53:15.684522 2033 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:40733
WARNING: no policy specified for oryx/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab.
Entry for principal oryx/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab.
I20260811 18:53:15.705621 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41651
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab
--principal=oryx/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:15.790427 2333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:15.790701 2333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:15.790750 2333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:15.792083 2333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:15.792135 2333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:15.792163 2333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:15.793622 2333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab
--principal=oryx/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:15.793824 2333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:15.794021 2333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:15.799268 2340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:15.799322 2342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:15.799299 2338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:15.799594 2333 server_base.cc:1034] running on GCE node
I20260811 18:53:15.799805 2333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:15.800086 2333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:15.801247 2333 hybrid_clock.cc:648] HybridClock initialized: now 1786474395801229 us; error 40 us; skew 500 ppm
Aug 11 18:53:15 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:15.803879 2333 init.cc:377] Logged in from keytab as oryx/127.23.226.194@KRBTEST.COM (short username oryx)
I20260811 18:53:15.804368 2333 webserver.cc:460] Webserver started at http://127.23.226.194:34329/ using document root <none> and password file <none>
I20260811 18:53:15.804621 2333 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:15.804675 2333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:15.804818 2333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:15.805886 2333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "5e7bfc6f26104af786a1dd2cd1c014f0"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "527189673bd668ccdd25f3f71a0f0465"
server_key_iv: "aed8a35a10601f2e9f6ab3485b664473"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.806264 2333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "5e7bfc6f26104af786a1dd2cd1c014f0"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "527189673bd668ccdd25f3f71a0f0465"
server_key_iv: "aed8a35a10601f2e9f6ab3485b664473"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.807695 2333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:15.808513 2352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:15.808748 2333 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:15.808828 2333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "5e7bfc6f26104af786a1dd2cd1c014f0"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "527189673bd668ccdd25f3f71a0f0465"
server_key_iv: "aed8a35a10601f2e9f6ab3485b664473"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.808918 2333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:15.834060 2333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:15.836342 2333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:15.836489 2333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:15.836771 2333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:15.837177 2333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:15.837240 2333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:15.837287 2333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:15.837314 2333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:15.843565 2333 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:46393
I20260811 18:53:15.843619 2518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:46393 every 8 connection(s)
I20260811 18:53:15.843925 2333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:53:15 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:15.851155 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 2333
I20260811 18:53:15.851261 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:15.851501 24459 external_mini_cluster.cc:1428] Setting key 785ba34d11fc42e6f70fd9dd30252e4f
I20260811 18:53:15.853618 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:15.844706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:42293 (local address 127.23.226.254:41651)
0811 18:53:15.844773 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:15.844776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:15.845012 (+ 236us) server_negotiation.cc:407] Connection header received
0811 18:53:15.845516 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:15.845518 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:15.845530 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:15.845605 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:15.846535 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.847035 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.848015 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.848241 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.848301 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:15.850524 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:15.850526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:15.850526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:15.850534 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:15.852228 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:15.852639 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:15.852641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:15.852641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:15.852705 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:15.852964 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:15.852965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:15.852965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:15.853089 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:15.853164 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:15.853446 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 18:53:15.853529 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:53:15.853832 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:15.844673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.194:42293)
0811 18:53:15.844857 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:15.844900 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:15.845397 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:15.845656 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:15.845659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:15.846237 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:15.846449 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:15.846453 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.847129 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.847130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:15.847931 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:15.847933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:15.848324 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:15.848324 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:15.848423 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:15.848898 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:15.848907 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:15.850366 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:15.852308 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:15.852317 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:15.852319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:15.852549 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:15.852775 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:15.852776 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:15.852777 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:15.852894 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:15.853167 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:15.853175 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:15.853313 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 18:53:15.853421 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:53:15.853580 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260811 18:53:15.854461 2519 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41651
I20260811 18:53:15.854557 2519 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:15.854763 2519 heartbeater.cc:511] Master 127.23.226.254:41651 requested a full tablet report, sending...
I20260811 18:53:15.855177 2033 ts_manager.cc:194] Registered new tserver with Master: 5e7bfc6f26104af786a1dd2cd1c014f0 (127.23.226.194:46393)
I20260811 18:53:15.855554 2033 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:42293
WARNING: no policy specified for oryx/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab.
Entry for principal oryx/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab.
I20260811 18:53:15.882387 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41651
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab
--principal=oryx/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:15.968017 2525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:15.968223 2525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:15.968253 2525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:15.969350 2525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:15.969388 2525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:15.969413 2525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:15.970858 2525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab
--principal=oryx/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:15.971064 2525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:15.971236 2525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:15.976446 2536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:15.976449 2532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:15.976615 2525 server_base.cc:1034] running on GCE node
W20260811 18:53:15.976505 2533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:15.976965 2525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:15.977207 2525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:15.978353 2525 hybrid_clock.cc:648] HybridClock initialized: now 1786474395978326 us; error 50 us; skew 500 ppm
Aug 11 18:53:15 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:15.980932 2525 init.cc:377] Logged in from keytab as oryx/127.23.226.195@KRBTEST.COM (short username oryx)
I20260811 18:53:15.981436 2525 webserver.cc:460] Webserver started at http://127.23.226.195:41633/ using document root <none> and password file <none>
I20260811 18:53:15.981690 2525 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:15.981763 2525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:15.981915 2525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:15.983013 2525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "97fcf27707494f729d8747377378bb81"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "b70190be507f936405befeb28370ff04"
server_key_iv: "789b9419b988e9c77209da14ba7dc6e9"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.983388 2525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "97fcf27707494f729d8747377378bb81"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "b70190be507f936405befeb28370ff04"
server_key_iv: "789b9419b988e9c77209da14ba7dc6e9"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.984751 2525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:15.985625 2545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:15.985818 2525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:15.985934 2525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "97fcf27707494f729d8747377378bb81"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "b70190be507f936405befeb28370ff04"
server_key_iv: "789b9419b988e9c77209da14ba7dc6e9"
server_key_version: "encryptionkey@0"
I20260811 18:53:15.986018 2525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.000553 2525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:16.002705 2525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:16.002875 2525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:16.003134 2525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:16.003470 2525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:16.003528 2525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.003569 2525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:16.003597 2525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.009930 2525 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:38625
I20260811 18:53:16.010007 2715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:38625 every 8 connection(s)
I20260811 18:53:16.010353 2525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:16.018250 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 2525
I20260811 18:53:16.018343 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:16.018560 24459 external_mini_cluster.cc:1428] Setting key 9d2bba947a55b94e2f94d498a95ad52e
I20260811 18:53:16.021032 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.011191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:39219 (local address 127.23.226.254:41651)
0811 18:53:16.011238 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.011239 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.011440 (+ 201us) server_negotiation.cc:407] Connection header received
0811 18:53:16.012027 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.012028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.012040 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.012110 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.013325 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.013817 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.014992 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.015171 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.015233 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.017679 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.017680 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.017680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.017687 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.019546 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.019970 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.019971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.019972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.020039 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.020324 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.020325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.020325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.020449 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.020527 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.020839 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.020925 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:53:16.021279 2720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.011127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:39219)
0811 18:53:16.011304 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.011348 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.011903 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.012247 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.012251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.013002 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.013227 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.013233 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.013907 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.013908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.014912 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.014914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.015260 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.015261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.015384 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.016003 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.016013 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.017582 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.019628 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.019637 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.019640 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.019886 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.020121 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.020121 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.020122 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.020244 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.020518 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.020527 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.020669 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.020803 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.020976 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260811 18:53:16.021798 2717 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41651
I20260811 18:53:16.021904 2717 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:16.022056 2717 heartbeater.cc:511] Master 127.23.226.254:41651 requested a full tablet report, sending...
I20260811 18:53:16.022543 2033 ts_manager.cc:194] Registered new tserver with Master: 97fcf27707494f729d8747377378bb81 (127.23.226.195:38625)
I20260811 18:53:16.022933 2033 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:39219
I20260811 18:53:16.030587 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.23.226.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.253.keytab.
Entry for principal oryx/127.23.226.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.253.keytab.
I20260811 18:53:16.061276 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.253:39153
--webserver_interface=127.23.226.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.253.keytab
--principal=oryx/127.23.226.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:41651,127.23.226.253:39153
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:16.145296 2726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:16.145546 2726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:16.145588 2726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:16.146842 2726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:16.146906 2726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:16.146934 2726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:16.146965 2726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:16.146991 2726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:16.148478 2726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:41651,127.23.226.253:39153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.253.keytab
--principal=oryx/127.23.226.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.253:39153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.226.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
W20260811 18:53:16.148639 2726 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.23.226.254:41651,127.23.226.253:39153'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 18:53:16.148789 2726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:16.149068 2726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:16.153935 2737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.153942 2733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.153941 2734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:16.154211 2726 server_base.cc:1034] running on GCE node
I20260811 18:53:16.154556 2726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:16.154824 2726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:16.156004 2726 hybrid_clock.cc:648] HybridClock initialized: now 1786474396155989 us; error 33 us; skew 500 ppm
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:16.158640 2726 init.cc:377] Logged in from keytab as oryx/127.23.226.253@KRBTEST.COM (short username oryx)
I20260811 18:53:16.159117 2726 webserver.cc:460] Webserver started at http://127.23.226.253:36213/ using document root <none> and password file <none>
I20260811 18:53:16.159361 2726 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.159431 2726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.159567 2726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:16.160754 2726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data/instance:
uuid: "6590792d2b3e4e0f9755281f349dd00f"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "a253f4d24b21696e92543d280e1986e3"
server_key_iv: "a0c03e2063c55e1562f9b865dcfdd4b6"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.161128 2726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal/instance:
uuid: "6590792d2b3e4e0f9755281f349dd00f"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "a253f4d24b21696e92543d280e1986e3"
server_key_iv: "a0c03e2063c55e1562f9b865dcfdd4b6"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.162642 2726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 18:53:16.163381 2745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.163560 2726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:16.163669 2726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
uuid: "6590792d2b3e4e0f9755281f349dd00f"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "a253f4d24b21696e92543d280e1986e3"
server_key_iv: "a0c03e2063c55e1562f9b865dcfdd4b6"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.163749 2726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.175417 2726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:16.177335 2726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:16.177487 2726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:16.181643 2726 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.253:39153
I20260811 18:53:16.181700 2826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.253:39153 every 8 connection(s)
I20260811 18:53:16.182076 2726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
I20260811 18:53:16.183055 2827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:16.184649 2827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:16.187325 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 2726
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.253@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.226.253@KRBTEST.COM
I20260811 18:53:16.195387 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.185480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53856 (local address 127.23.226.254:41651)
0811 18:53:16.185574 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.185582 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.185667 (+ 85us) server_negotiation.cc:407] Connection header received
0811 18:53:16.186153 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.186154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.186164 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.186219 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.186915 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.187594 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.189048 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.189240 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.189290 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.191828 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.191830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.191831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.191840 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.193559 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.194120 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.194122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.194122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.194214 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.194520 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.194521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.194522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.194762 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.194862 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.195181 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.195278 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:53:16.195421 2831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.185363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:53856)
0811 18:53:16.185563 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.185601 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.186065 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.186301 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.186305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.186630 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.186838 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.186844 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.187704 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.187706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.188957 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.188961 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.189320 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.189321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.189453 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.190057 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.190069 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.191695 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.193679 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.193687 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.193689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.194030 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.194297 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.194298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.194298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.194453 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.194863 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.194871 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.195010 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.195097 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.195245 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":81,"threads_started":1}
I20260811 18:53:16.196134 2827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:16.197543 2835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.187954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55772 (local address 127.23.226.253:39153)
0811 18:53:16.188149 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.188153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.188175 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:53:16.188199 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.188201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.188221 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.188313 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.188976 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.190015 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.190859 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.191183 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.191258 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.193626 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.193638 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.193638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.193647 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.196131 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.196557 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.196560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.196561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.196632 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.196855 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.196856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.196856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.197058 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.197279 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.197322 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.197441 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":117,"threads_started":1}
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.253@KRBTEST.COM for oryx/127.23.226.253@KRBTEST.COM
I20260811 18:53:16.203369 2836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.196499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55778 (local address 127.23.226.253:39153)
0811 18:53:16.196679 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.196681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.196688 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:53:16.196708 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.196708 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.196719 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.196817 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.197139 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.197901 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.198768 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.198960 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.199017 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.200614 (+ 1597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.200615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.200616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.200622 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.202262 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.202662 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.202664 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.202664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.202718 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.202908 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.202908 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.202908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.202997 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.203044 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.203215 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.203287 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":127,"threads_started":1}
I20260811 18:53:16.203483 2831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.196434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.0.0.1:55778)
0811 18:53:16.196492 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.196503 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.196545 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.196854 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.196855 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.197012 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.197050 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.197052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.198003 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.198004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.198686 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.198689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.199030 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.199031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.199077 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.199396 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.199400 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.200529 (+ 1129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.202341 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.202342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.202342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.202592 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.202797 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.202798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.202798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.202856 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.203072 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.203073 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.203113 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.203198 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.203343 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":40}
I20260811 18:53:16.204825 2827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Bootstrap starting.
I20260811 18:53:16.205526 2827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:16.205834 2827 log.cc:824] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:16.206686 2827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: No bootstrap required, opened a new log
I20260811 18:53:16.208101 2827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } }
I20260811 18:53:16.208235 2827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:16.208261 2827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6590792d2b3e4e0f9755281f349dd00f, State: Initialized, Role: FOLLOWER
I20260811 18:53:16.208412 2827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } }
I20260811 18:53:16.208734 2827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:16.208698 2840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } } }
I20260811 18:53:16.208813 2840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:53:16.210557 2854 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:16.210618 2854 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:16.212467 2726 master_runner.cc:428] Detected that this master 6590792d2b3e4e0f9755281f349dd00f is joining an existing cluster
I20260811 18:53:16.212550 2726 master_runner.cc:432] Initiating AddMaster RPC to add 127.23.226.253:39153
I20260811 18:53:16.222064 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.213763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53864 (local address 127.23.226.254:41651)
0811 18:53:16.213808 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.213810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.214007 (+ 197us) server_negotiation.cc:407] Connection header received
0811 18:53:16.214034 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.214035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.214047 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.214098 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.214637 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.215383 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.216470 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.216679 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.216798 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.218361 (+ 1563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.218363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.218363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.218372 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.220728 (+ 2356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.221221 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.221223 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.221223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.221288 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.221497 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.221498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.221499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.221619 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.221695 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.221875 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.221966 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:16.222070 2863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.213653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:53864)
0811 18:53:16.213889 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.213900 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.213962 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.214150 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.214151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.214436 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.214523 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.214526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.215472 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.215473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.216351 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.216354 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.216824 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.216825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.216893 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.217788 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.217793 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.218269 (+ 476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.220835 (+ 2566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.220836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.220837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.221132 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.221363 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.221364 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.221364 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.221433 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.221700 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.221701 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.221746 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.221837 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.221946 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":153,"threads_started":1}
I20260811 18:53:16.222311 2836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.213839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55794 (local address 127.23.226.253:39153)
0811 18:53:16.213872 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.213874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.214077 (+ 203us) server_negotiation.cc:407] Connection header received
0811 18:53:16.214136 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.214137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.214146 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.214201 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.214612 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.215376 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.217388 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.217630 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.217688 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.218799 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.218801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.218801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.218809 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.221180 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.221547 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.221548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.221549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.221592 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.221777 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.221778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.221778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.221915 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.221977 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.222146 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.222233 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:53:16.222579 2864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.213657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.0.0.1:55794)
0811 18:53:16.214011 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.214018 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.214080 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.214206 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.214206 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.214468 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.214529 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.214531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.216458 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.216459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.217300 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.217302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.217717 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.217718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.217794 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.218262 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.218267 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.218689 (+ 422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.221268 (+ 2579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.221269 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.221269 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.221474 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.221654 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.221655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.221655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.221713 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.222001 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.222002 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.222034 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.222364 (+ 330us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.222486 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"spinlock_wait_cycles":9984,"thread_start_us":156,"threads_started":1}
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.254@KRBTEST.COM for oryx/127.23.226.253@KRBTEST.COM
I20260811 18:53:16.233060 2836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.225269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55796 (local address 127.23.226.253:39153)
0811 18:53:16.225306 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.225308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.225463 (+ 155us) server_negotiation.cc:407] Connection header received
0811 18:53:16.225565 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.225566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.225574 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.225626 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.226139 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.226661 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.227787 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.227958 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.228015 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.230276 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.230278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.230278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.230286 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.231704 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.232104 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.232105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.232105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.232168 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.232433 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.232435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.232435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.232551 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.232627 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.232881 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.232959 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:53:16.233071 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.225172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.0.0.1:55796)
0811 18:53:16.225353 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.225398 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.225474 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.225645 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.225649 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.226001 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.226063 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.226066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.226743 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.226744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.227688 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.227691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.228037 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.228038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.228130 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.228553 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.228558 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.230174 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.231797 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.231805 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.231807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.232022 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.232295 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.232296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.232297 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.232365 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.232633 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.232642 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.232696 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.232826 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.232964 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":77,"threads_started":1}
I20260811 18:53:16.233651 2033 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.23.226.253:39153: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f"
member_type: NON_VOTER
last_known_addr {
host: "127.23.226.253"
port: 39153
}
attrs {
promote: true
}
}
dest_uuid: "31f61ea6c86349e0b4347eca8244742d"
cas_config_opid_index: -1
I20260811 18:53:16.233989 2033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } }
I20260811 18:53:16.234513 2869 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 6590792d2b3e4e0f9755281f349dd00f (127.23.226.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } }
I20260811 18:53:16.234917 2789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:16.235709 2869 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.23.226.253:39153
I20260811 18:53:16.235874 2868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } }
I20260811 18:53:16.235942 2789 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Refusing update from remote peer 31f61ea6c86349e0b4347eca8244742d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 18:53:16.235976 2868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:16.236454 2726 master.cc:537] Master@127.23.226.253:39153 shutting down...
I20260811 18:53:16.236440 2868 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 18:53:16.237247 2010 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 18:53:16.237689 2010 consensus_peers.cc:487] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d -> Peer 6590792d2b3e4e0f9755281f349dd00f (127.23.226.253:39153): Couldn't send request to peer 6590792d2b3e4e0f9755281f349dd00f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:53:16.239405 2726 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:16.239498 2726 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:16.239552 2726 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: stopping tablet replica
I20260811 18:53:16.252624 2726 master.cc:552] Master@127.23.226.253:39153 shutdown complete.
I20260811 18:53:16.252679 2726 master_runner.cc:305] Clearing existing system tablet
I20260811 18:53:16.252833 2726 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.252884 2726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.253615 2726 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s
I20260811 18:53:16.254174 2875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.254351 2726 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.254434 2726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.254462 2726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
uuid: "6590792d2b3e4e0f9755281f349dd00f"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "a253f4d24b21696e92543d280e1986e3"
server_key_iv: "a0c03e2063c55e1562f9b865dcfdd4b6"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.255319 2726 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:16.257000 2726 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 18:53:16.257076 2726 log.cc:1196] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 18:53:16.257293 2726 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Deleting consensus metadata
I20260811 18:53:16.257421 2726 master_runner.cc:315] Copying system tablet from 127.23.226.254:41651
I20260811 18:53:16.258061 2726 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: tablet copy: Beginning tablet copy session from remote peer at address 127.23.226.254:41651
I20260811 18:53:16.264783 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.258593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53880 (local address 127.23.226.254:41651)
0811 18:53:16.258663 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.258665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.258678 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:53:16.258766 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.258766 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.258776 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.258823 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.259182 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.259786 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.260867 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.261063 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.261114 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.262203 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.262204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.262204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.262211 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.263618 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.264043 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.264044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.264044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.264102 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.264314 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.264315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.264316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.264419 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.264472 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.264638 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.264719 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 18:53:16.264837 2883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.258372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:53880)
0811 18:53:16.258612 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.258625 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.258687 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.258839 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.258840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.259042 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.259113 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.259115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.259865 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.259867 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.260773 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.260777 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.261139 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.261140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.261215 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.261676 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.261682 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.262119 (+ 437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.263704 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.263705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.263706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.263960 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.264174 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.264175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.264175 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.264245 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.264486 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.264487 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.264536 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.264610 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.264716 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":176,"threads_started":1}
I20260811 18:53:16.265197 2064 tablet_copy_service.cc:140] P 31f61ea6c86349e0b4347eca8244742d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6590792d2b3e4e0f9755281f349dd00f ({username='oryx', principal='oryx/127.23.226.253@KRBTEST.COM'} at 127.0.0.1:53880)
I20260811 18:53:16.265307 2064 tablet_copy_service.cc:161] P 31f61ea6c86349e0b4347eca8244742d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6590792d2b3e4e0f9755281f349dd00f at {username='oryx', principal='oryx/127.23.226.253@KRBTEST.COM'} at 127.0.0.1:53880: session id = 6590792d2b3e4e0f9755281f349dd00f-00000000000000000000000000000000
I20260811 18:53:16.266144 2064 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 18:53:16.266812 2726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 18:53:16.267758 2726 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: tablet copy: Starting download of 0 data blocks...
I20260811 18:53:16.267931 2726 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: tablet copy: Starting download of 1 WAL segments...
I20260811 18:53:16.269026 2726 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 18:53:16.269882 2064 tablet_copy_service.cc:342] P 31f61ea6c86349e0b4347eca8244742d: Request end of tablet copy session 6590792d2b3e4e0f9755281f349dd00f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.23.226.253@KRBTEST.COM'} at 127.0.0.1:53880
I20260811 18:53:16.269949 2064 tablet_copy_service.cc:433] P 31f61ea6c86349e0b4347eca8244742d: ending tablet copy session 6590792d2b3e4e0f9755281f349dd00f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6590792d2b3e4e0f9755281f349dd00f
I20260811 18:53:16.272538 2726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:16.273960 2885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.273957 2884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.275266 2888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:16.275570 2726 server_base.cc:1034] running on GCE node
I20260811 18:53:16.275695 2726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:16.275890 2726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:16.277021 2726 hybrid_clock.cc:648] HybridClock initialized: now 1786474396277014 us; error 25 us; skew 500 ppm
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:16.278389 2726 init.cc:377] Logged in from keytab as oryx/127.23.226.253@KRBTEST.COM (short username oryx)
I20260811 18:53:16.278754 2726 webserver.cc:460] Webserver started at http://127.23.226.253:33395/ using document root <none> and password file <none>
I20260811 18:53:16.278903 2726 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.278944 2726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.279613 2726 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:53:16.280190 2907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.280315 2726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:53:16.280366 2726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
uuid: "6590792d2b3e4e0f9755281f349dd00f"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "a253f4d24b21696e92543d280e1986e3"
server_key_iv: "a0c03e2063c55e1562f9b865dcfdd4b6"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.280426 2726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.298933 2726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:16.300872 2726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:16.304390 2726 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.253:39153
I20260811 18:53:16.304414 2984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.253:39153 every 8 connection(s)
I20260811 18:53:16.304790 2726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
I20260811 18:53:16.305554 2985 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:53:16.305992 2985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Bootstrap starting.
I20260811 18:53:16.308364 2985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:53:16.308614 2985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: Bootstrap complete.
I20260811 18:53:16.308815 2985 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } }
I20260811 18:53:16.308884 2985 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6590792d2b3e4e0f9755281f349dd00f, State: Initialized, Role: LEARNER
I20260811 18:53:16.308912 2985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } }
I20260811 18:53:16.309120 2985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:16.309134 2988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } }
I20260811 18:53:16.309242 2988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: This master's current role is: LEARNER
I20260811 18:53:16.310683 3003 catalog_manager.cc:1259] Loaded cluster ID: 8c2d940235c34ecd8de7a3c49e12889c
I20260811 18:53:16.310763 3003 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: loading cluster ID for follower catalog manager: success
I20260811 18:53:16.312114 3003 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: acquiring CA information for follower catalog manager: success
I20260811 18:53:16.312433 3003 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:53:16.357359 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.349914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55822 (local address 127.23.226.253:39153)
0811 18:53:16.350102 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.350104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.350116 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:53:16.350150 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.350151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.350163 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.350257 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.350964 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.352071 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.352851 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.353177 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.353263 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.354680 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.354681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.354682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.354689 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.356254 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.356606 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.356608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.356608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.356675 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.356862 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.356863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.356863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.356991 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.357090 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.357167 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.357251 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":93,"threads_started":1}
WARNING: no policy specified for oryx/127.23.226.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.252.keytab.
Entry for principal oryx/127.23.226.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.252.keytab.
I20260811 18:53:16.386756 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.252:35321
--webserver_interface=127.23.226.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.252.keytab
--principal=oryx/127.23.226.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:41651,127.23.226.253:39153,127.23.226.252:35321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:16.473219 3008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:16.473420 3008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:16.473443 3008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:16.474668 3008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:16.474711 3008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:16.474727 3008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:16.474759 3008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:16.474792 3008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:16.476286 3008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:41651,127.23.226.253:39153,127.23.226.252:35321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.252.keytab
--principal=oryx/127.23.226.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.252:35321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.226.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:16.476548 3008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:16.476820 3008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:16.482064 3019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.482033 3015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.482038 3016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:16.482349 3008 server_base.cc:1034] running on GCE node
I20260811 18:53:16.482623 3008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:16.482867 3008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:16.484022 3008 hybrid_clock.cc:648] HybridClock initialized: now 1786474396484011 us; error 29 us; skew 500 ppm
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:16.486824 3008 init.cc:377] Logged in from keytab as oryx/127.23.226.252@KRBTEST.COM (short username oryx)
I20260811 18:53:16.487372 3008 webserver.cc:460] Webserver started at http://127.23.226.252:34349/ using document root <none> and password file <none>
I20260811 18:53:16.487581 3008 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.487622 3008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.487715 3008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:16.488817 3008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data/instance:
uuid: "bbbe3448e43a44228511b5e50d266ef0"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "210540d9c45e2cc98182dafccd2370c8"
server_key_iv: "5766d15e15e22fae2ebfa65d4efea80b"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.489130 3008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal/instance:
uuid: "bbbe3448e43a44228511b5e50d266ef0"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "210540d9c45e2cc98182dafccd2370c8"
server_key_iv: "5766d15e15e22fae2ebfa65d4efea80b"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.490545 3008 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:16.491313 3027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.491521 3008 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:16.491609 3008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
uuid: "bbbe3448e43a44228511b5e50d266ef0"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "210540d9c45e2cc98182dafccd2370c8"
server_key_iv: "5766d15e15e22fae2ebfa65d4efea80b"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.491664 3008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.512355 3008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:16.514712 3008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:16.514835 3008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:16.518808 3008 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.252:35321
I20260811 18:53:16.518872 3109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.252:35321 every 8 connection(s)
I20260811 18:53:16.519282 3008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
I20260811 18:53:16.520334 3110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:16.521929 3110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:53:16.522373 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 3008
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.252@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.226.252@KRBTEST.COM
I20260811 18:53:16.532147 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.522796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53896 (local address 127.23.226.254:41651)
0811 18:53:16.522841 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.522846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.523110 (+ 264us) server_negotiation.cc:407] Connection header received
0811 18:53:16.523710 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.523712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.523727 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.523807 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.524355 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.524861 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.525940 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.526253 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.526319 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.528819 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.528821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.528821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.528829 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.530686 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.531151 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.531152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.531152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.531205 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.531471 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.531473 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.531473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.531605 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.531688 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.531969 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.532053 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:53:16.532343 3114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.522692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:53896)
0811 18:53:16.522995 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.523040 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.523587 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.523845 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.523847 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.524104 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.524257 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.524261 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.524962 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.524963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.525857 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.525859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.526359 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.526360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.526521 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.527102 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.527110 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.528723 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.530773 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.530778 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.530780 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.531076 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.531273 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.531274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.531274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.531411 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.531679 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.531687 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.531834 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.531946 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.532100 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":126,"threads_started":1}
I20260811 18:53:16.532541 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.522957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33926 (local address 127.23.226.252:35321)
0811 18:53:16.523187 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.523191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.523235 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:53:16.523592 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.523601 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.523629 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.523722 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.524385 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.525414 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.526326 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.526768 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.526832 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.529319 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.529328 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.529328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.529336 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.531330 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.531665 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.531670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.531671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.531736 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.531943 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.531944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.531944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.532087 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.532241 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.532350 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.532427 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":82,"threads_started":1}
I20260811 18:53:16.532976 3110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.252@KRBTEST.COM for oryx/127.23.226.253@KRBTEST.COM
I20260811 18:53:16.539758 3114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.533269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.0.0.1:55832)
0811 18:53:16.533395 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.533405 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.533459 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.533563 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.533564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.533674 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.533703 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.533704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.534392 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.534394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.535029 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.535031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.535415 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.535416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.535472 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.535838 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.535843 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.537154 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.538875 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.538876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.538876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.539057 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.539243 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.539244 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.539244 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.539299 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.539514 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.539515 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.539553 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.539616 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.539692 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260811 18:53:16.539783 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.533348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55832 (local address 127.23.226.253:39153)
0811 18:53:16.533421 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.533424 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.533448 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:53:16.533505 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.533506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.533518 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.533563 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.533766 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.534263 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.535116 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.535338 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.535394 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.537258 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.537260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.537260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.537268 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.538794 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.539130 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.539131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.539131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.539182 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.539354 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.539355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.539355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.539455 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.539508 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.539648 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.539721 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:53:16.540308 3110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.252@KRBTEST.COM for oryx/127.23.226.252@KRBTEST.COM
I20260811 18:53:16.546828 3114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.540552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.0.0.1:33938)
0811 18:53:16.540604 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.540616 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.540670 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.540828 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.540829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.540957 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.540981 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.540982 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.541627 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.541628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.542091 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.542092 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.542506 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.542507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.542556 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.542944 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.542948 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.544096 (+ 1148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.545685 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.545686 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.545686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.545864 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.546093 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.546093 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.546094 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.546154 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.546457 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.546458 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.546497 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.546599 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.546707 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 18:53:16.546882 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.540599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33938 (local address 127.23.226.252:35321)
0811 18:53:16.540629 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.540631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.540655 (+ 24us) server_negotiation.cc:407] Connection header received
0811 18:53:16.540759 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.540759 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.540769 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.540824 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.541062 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.541539 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.542176 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.542402 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.542509 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.544180 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.544181 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.544181 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.544189 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.545552 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.545944 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.545945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.545945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.546008 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.546230 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.546231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.546231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.546345 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.546421 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.546623 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.546762 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":15}
I20260811 18:53:16.548602 3110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Bootstrap starting.
I20260811 18:53:16.549436 3110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:16.549770 3110 log.cc:824] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:16.550704 3110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: No bootstrap required, opened a new log
I20260811 18:53:16.552202 3110 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } }
I20260811 18:53:16.552343 3110 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:16.552369 3110 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbbe3448e43a44228511b5e50d266ef0, State: Initialized, Role: FOLLOWER
I20260811 18:53:16.552510 3110 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } }
I20260811 18:53:16.552873 3110 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:16.552848 3119 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } } }
I20260811 18:53:16.552969 3119 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:53:16.554701 3133 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:16.554778 3133 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:16.557615 3008 master_runner.cc:428] Detected that this master bbbe3448e43a44228511b5e50d266ef0 is joining an existing cluster
I20260811 18:53:16.557673 3008 master_runner.cc:432] Initiating AddMaster RPC to add 127.23.226.252:35321
I20260811 18:53:16.584365 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 2122
I20260811 18:53:16.593531 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.559213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53908 (local address 127.23.226.254:41651)
0811 18:53:16.559259 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.559261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.559271 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:16.559395 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.559397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.559409 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.559442 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.560055 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.560860 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.562333 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.562696 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.562743 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.590356 (+ 27613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.590359 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.590360 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.590370 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.592186 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.592602 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.592603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.592603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.592657 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.592863 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.592863 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.592864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.593012 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.593059 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.593294 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.593388 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:16.594262 3143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.558943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:53908)
0811 18:53:16.559217 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.559228 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.559287 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.559550 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.559551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.559874 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.559950 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.559952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.560984 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.560984 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.562224 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.562227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.562853 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.562853 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.562919 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.589766 (+ 26847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.589774 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.590224 (+ 450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.592297 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.592298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.592299 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.592523 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.592723 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.592724 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.592724 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.592800 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.593118 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.593119 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.593181 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.593947 (+ 766us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.594099 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":181,"thread_start_us":96,"threads_started":1}
I20260811 18:53:16.624631 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.559119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33954 (local address 127.23.226.252:35321)
0811 18:53:16.559155 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.559157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.559273 (+ 116us) server_negotiation.cc:407] Connection header received
0811 18:53:16.559359 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.559360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.559368 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.559396 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.559968 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.560732 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.561828 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.562119 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.562160 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.563481 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.563483 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.563483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.563489 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.589255 (+ 25766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.623709 (+ 34454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.623711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.623712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.623773 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.623972 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.623973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.623973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.624110 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.624154 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.624342 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.624472 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:53:16.624821 3140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.558930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.0.0.1:33954)
0811 18:53:16.559203 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.559214 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.559295 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.559452 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.559453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.559803 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.559879 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.559881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.560857 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.560858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.561736 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.561740 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.562267 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.562268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.562334 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.562889 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.562895 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.563376 (+ 481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.623259 (+ 59883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.623261 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.623262 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.623591 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.623843 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.623844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.623845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.623908 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.624194 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.624195 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.624243 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.624391 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.624582 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":75,"thread_start_us":90,"threads_started":1}
I20260811 18:53:16.629704 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:44615
--local_ip_for_outbound_sockets=127.23.226.193
--tserver_master_addrs=127.23.226.254:41651
--webserver_port=38487
--webserver_interface=127.23.226.193
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab
--principal=oryx/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153,127.23.226.252:35321 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:53:16.630026 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.558971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55842 (local address 127.23.226.253:39153)
0811 18:53:16.559021 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.559023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.559383 (+ 360us) server_negotiation.cc:407] Connection header received
0811 18:53:16.559495 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.559496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.559509 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.559540 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.560055 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.560812 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.562333 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.563029 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.563075 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.625776 (+ 62701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.625779 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.625780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.625791 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.628011 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.628885 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.628887 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.628887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.628968 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.629225 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.629227 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.629227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.629390 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.629459 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.629703 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.629870 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:53:16.631153 3142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.559087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.0.0.1:55842)
0811 18:53:16.559323 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.559333 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.559419 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.559607 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.559608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.559900 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.559956 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.559958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.560917 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.560918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.562224 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.562227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.563141 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.563141 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.563186 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.563627 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.563631 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.625630 (+ 61999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.628136 (+ 2506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.628138 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.628138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.628559 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.629059 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.629060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.629061 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.629144 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.629522 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.629523 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.629578 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.630802 (+ 1224us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.630949 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":44,"thread_start_us":74,"threads_started":1}
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474395, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.254@KRBTEST.COM for oryx/127.23.226.252@KRBTEST.COM
I20260811 18:53:16.637522 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.628836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33960 (local address 127.23.226.252:35321)
0811 18:53:16.628903 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.628905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.628913 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:53:16.628950 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.628951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.628961 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.629015 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.629410 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.630120 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.631224 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.631527 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.631587 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.634037 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.634039 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.634039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.634047 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.635896 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.636392 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.636393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.636394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.636458 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.636711 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.636712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.636713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.636849 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.636927 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.637319 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.637411 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:53:16.637580 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.628641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.0.0.1:33960)
0811 18:53:16.628698 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.628711 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.628752 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.629071 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.629072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.629271 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.629323 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.629326 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.630218 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.630219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.631124 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.631128 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.631641 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.631642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.631710 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.632129 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.632135 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.633928 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.636001 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.636003 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.636003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.636299 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.636545 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.636546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.636546 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.636631 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.636938 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.636940 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.637003 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.637266 (+ 263us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.637419 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 18:53:16.638768 2033 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.23.226.252:35321: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0"
member_type: NON_VOTER
last_known_addr {
host: "127.23.226.252"
port: 35321
}
attrs {
promote: true
}
}
dest_uuid: "31f61ea6c86349e0b4347eca8244742d"
cas_config_opid_index: 5
I20260811 18:53:16.639091 2033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } }
I20260811 18:53:16.639644 2869 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.639838 3065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:16.640802 2869 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.23.226.252:35321
I20260811 18:53:16.640817 3065 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Refusing update from remote peer 31f61ea6c86349e0b4347eca8244742d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 18:53:16.640892 2869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.640976 2869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:16.641497 2868 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:16.641922 3008 master.cc:537] Master@127.23.226.252:35321 shutting down...
W20260811 18:53:16.643821 2004 consensus_peers.cc:487] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d -> Peer bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252:35321): Couldn't send request to peer bbbe3448e43a44228511b5e50d266ef0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 18:53:16.645694 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.641262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.0.0.1:55850)
0811 18:53:16.641307 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.641321 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.641480 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.641805 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.641806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.641808 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:16.641853 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.641854 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.642957 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.642958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.644341 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.644344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.645438 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.645439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.645512 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.645535 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.645581 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.645621 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 18:53:16.646086 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.641397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55850 (local address 127.23.226.253:39153)
0811 18:53:16.641445 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.641447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.641456 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:16.641590 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.641591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.641617 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.641678 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:16.641931 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.642856 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.644455 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.645142 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.645197 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.645276 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.645953 (+ 677us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.646000 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:53:16.646567 3008 raft_consensus.cc:2229] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:16.646595 2951 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 LEARNER]: Refusing update from remote peer 31f61ea6c86349e0b4347eca8244742d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 18:53:16.646668 3008 raft_consensus.cc:2258] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:16.646719 3008 tablet_replica.cc:330] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: stopping tablet replica
I20260811 18:53:16.646797 2868 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 18:53:16.647392 2951 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.648605 2988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31f61ea6c86349e0b4347eca8244742d. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.648690 2988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: This master's current role is: LEARNER
I20260811 18:53:16.648630 3147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: NON_VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: true } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.648741 3147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: This master's current role is: LEARNER
I20260811 18:53:16.650982 2868 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: attempting to promote NON_VOTER 6590792d2b3e4e0f9755281f349dd00f to VOTER
I20260811 18:53:16.651237 2868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } }
I20260811 18:53:16.651790 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.651669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.0.0.1:33968)
0811 18:53:16.651717 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.651759 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 18:53:16.651791 2951 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 LEARNER]: Refusing update from remote peer 31f61ea6c86349e0b4347eca8244742d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 18:53:16.651978 2869 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 18:53:16.652447 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.652098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.0.0.1:33982)
0811 18:53:16.652377 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.652413 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:35321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":153,"threads_started":1}
W20260811 18:53:16.652658 2004 consensus_peers.cc:487] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d -> Peer bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252:35321): Couldn't send request to peer bbbe3448e43a44228511b5e50d266ef0. Status: Network error: Client connection negotiation failed: client connection to 127.23.226.252:35321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 18:53:16.652698 2869 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6590792d2b3e4e0f9755281f349dd00f (127.23.226.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.653795 2869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.653882 2869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:16.653949 2869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.654012 2869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:16.654314 2951 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6590792d2b3e4e0f9755281f349dd00f (127.23.226.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.655534 3147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.655632 3147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:16.661471 3008 master.cc:552] Master@127.23.226.252:35321 shutdown complete.
I20260811 18:53:16.661531 3008 master_runner.cc:305] Clearing existing system tablet
I20260811 18:53:16.661692 3008 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.661746 3008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.662614 3008 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:16.663265 3152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.663441 3008 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.663506 3008 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:16.663532 3008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
uuid: "bbbe3448e43a44228511b5e50d266ef0"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "210540d9c45e2cc98182dafccd2370c8"
server_key_iv: "5766d15e15e22fae2ebfa65d4efea80b"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.664343 3008 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:16.666117 3008 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 18:53:16.666214 3008 log.cc:1196] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 18:53:16.666641 3008 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Deleting consensus metadata
I20260811 18:53:16.666807 3008 master_runner.cc:315] Copying system tablet from 127.23.226.254:41651
I20260811 18:53:16.667817 3008 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: tablet copy: Beginning tablet copy session from remote peer at address 127.23.226.254:41651
I20260811 18:53:16.676515 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.668296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53922 (local address 127.23.226.254:41651)
0811 18:53:16.668349 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.668351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.668463 (+ 112us) server_negotiation.cc:407] Connection header received
0811 18:53:16.668557 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.668559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.668573 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.668637 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.669074 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.669956 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.671166 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.671496 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.671581 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.672888 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.672890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.672891 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.672900 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.674964 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.675439 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.675440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.675441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.675513 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.675771 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.675772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.675772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.676014 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.676106 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.676318 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.676411 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:53:16.676519 3158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.668237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:53922)
0811 18:53:16.668376 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.668388 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.668461 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.668664 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.668665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.668903 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.668975 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.668977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.670081 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.670082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.671053 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.671056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.671600 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.671602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.671683 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.672287 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.672293 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.672773 (+ 480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.675080 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.675082 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.675082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.675344 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.675602 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.675603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.675604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.675689 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.676126 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.676128 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.676185 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.676277 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.676404 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260811 18:53:16.677213 2064 tablet_copy_service.cc:140] P 31f61ea6c86349e0b4347eca8244742d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer bbbe3448e43a44228511b5e50d266ef0 ({username='oryx', principal='oryx/127.23.226.252@KRBTEST.COM'} at 127.0.0.1:53922)
I20260811 18:53:16.677322 2064 tablet_copy_service.cc:161] P 31f61ea6c86349e0b4347eca8244742d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer bbbe3448e43a44228511b5e50d266ef0 at {username='oryx', principal='oryx/127.23.226.252@KRBTEST.COM'} at 127.0.0.1:53922: session id = bbbe3448e43a44228511b5e50d266ef0-00000000000000000000000000000000
I20260811 18:53:16.678004 2064 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 18:53:16.678617 3008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 18:53:16.680261 3008 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: tablet copy: Starting download of 0 data blocks...
I20260811 18:53:16.680514 3008 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: tablet copy: Starting download of 1 WAL segments...
I20260811 18:53:16.681625 3008 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 18:53:16.682922 2064 tablet_copy_service.cc:342] P 31f61ea6c86349e0b4347eca8244742d: Request end of tablet copy session bbbe3448e43a44228511b5e50d266ef0-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.23.226.252@KRBTEST.COM'} at 127.0.0.1:53922
I20260811 18:53:16.682982 2064 tablet_copy_service.cc:433] P 31f61ea6c86349e0b4347eca8244742d: ending tablet copy session bbbe3448e43a44228511b5e50d266ef0-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer bbbe3448e43a44228511b5e50d266ef0
I20260811 18:53:16.686357 3008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:16.687703 3159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.687841 3160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.688036 3162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:16.688611 3008 server_base.cc:1034] running on GCE node
I20260811 18:53:16.688797 3008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:16.689090 3008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:16.690289 3008 hybrid_clock.cc:648] HybridClock initialized: now 1786474396690280 us; error 30 us; skew 500 ppm
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:16.692130 3008 init.cc:377] Logged in from keytab as oryx/127.23.226.252@KRBTEST.COM (short username oryx)
I20260811 18:53:16.692494 3008 webserver.cc:460] Webserver started at http://127.23.226.252:44715/ using document root <none> and password file <none>
I20260811 18:53:16.692687 3008 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.692770 3008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.693674 3008 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:16.694368 3171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.694587 3008 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:16.694643 3008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
uuid: "bbbe3448e43a44228511b5e50d266ef0"
format_stamp: "Formatted at 2026-08-11 18:53:16 on dist-test-slave-68xk"
server_key: "210540d9c45e2cc98182dafccd2370c8"
server_key_iv: "5766d15e15e22fae2ebfa65d4efea80b"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.694701 3008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.714450 3008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:16.716761 3008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:16.720412 3008 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.252:35321
I20260811 18:53:16.720464 3254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.252:35321 every 8 connection(s)
I20260811 18:53:16.720968 3008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
I20260811 18:53:16.722157 3260 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:53:16.722793 3260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Bootstrap starting.
I20260811 18:53:16.726191 3260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:53:16.726480 3260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Bootstrap complete.
I20260811 18:53:16.726706 3260 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } }
I20260811 18:53:16.726807 3260 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bbbe3448e43a44228511b5e50d266ef0, State: Initialized, Role: LEARNER
I20260811 18:53:16.726856 3260 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } }
I20260811 18:53:16.727049 3260 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:16.727065 3264 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:16.727327 3264 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: This master's current role is: LEARNER
I20260811 18:53:16.728639 3278 catalog_manager.cc:1259] Loaded cluster ID: 8c2d940235c34ecd8de7a3c49e12889c
I20260811 18:53:16.729681 3278 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: loading cluster ID for follower catalog manager: success
I20260811 18:53:16.731261 3278 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: acquiring CA information for follower catalog manager: success
I20260811 18:53:16.731756 3278 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 18:53:16.752198 3145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:16.752439 3145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:16.752483 3145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:16.753782 3145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:16.753855 3145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:16.753906 3145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:16.755692 3145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab
--principal=oryx/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:44615
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=38487
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153,127.23.226.252:35321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:16.755993 3145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:16.756263 3145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:16.762192 3284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.762279 3287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.762200 3283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:16.762542 3145 server_base.cc:1034] running on GCE node
I20260811 18:53:16.762821 3145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:16.763098 3145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:16.764278 3145 hybrid_clock.cc:648] HybridClock initialized: now 1786474396764252 us; error 39 us; skew 500 ppm
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:16.767163 3145 init.cc:377] Logged in from keytab as oryx/127.23.226.193@KRBTEST.COM (short username oryx)
I20260811 18:53:16.767660 3145 webserver.cc:460] Webserver started at http://127.23.226.193:38487/ using document root <none> and password file <none>
I20260811 18:53:16.767940 3145 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.768003 3145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.769441 3145 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:16.770192 3300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.770537 3145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:16.770704 3145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "7318cee0f47143acaf4a37c441d84ee2"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "4bb78dfad2c8127f62c29aff1ef0114f"
server_key_iv: "bd0dfb686029493c227c355f72792d9d"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.771104 3145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.799764 3145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:16.801786 3145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:16.801959 3145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:16.802232 3145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:16.802668 3145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:16.802729 3145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.802775 3145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:16.802803 3145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.809154 3145 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:44615
I20260811 18:53:16.809242 3455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:44615 every 8 connection(s)
I20260811 18:53:16.809680 3145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.252@KRBTEST.COM
I20260811 18:53:16.818377 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 3145
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.253@KRBTEST.COM
I20260811 18:53:16.818571 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 2333
I20260811 18:53:16.835501 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.810931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:37291 (local address 127.23.226.254:41651)
0811 18:53:16.811021 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.811024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.811242 (+ 218us) server_negotiation.cc:407] Connection header received
0811 18:53:16.811707 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.811709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.811721 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.811752 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.812743 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.813564 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.814880 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.815197 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.815239 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.831381 (+ 16142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.831383 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.831384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.831392 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.833540 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.834192 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.834194 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.834194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.834264 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.834607 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.834609 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.834609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.834770 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.834820 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.835280 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.835374 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:53:16.835867 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.810765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:34925 (local address 127.23.226.253:39153)
0811 18:53:16.810883 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.810886 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.811214 (+ 328us) server_negotiation.cc:407] Connection header received
0811 18:53:16.811689 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.811691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.811704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.811743 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.812714 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.813565 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.814857 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.815106 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.815197 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.830965 (+ 15768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.830969 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.830969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.830982 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.833333 (+ 2351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.834661 (+ 1328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.834663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.834664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.834749 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.835028 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.835030 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.835030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.835247 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.835322 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.835592 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.835712 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 18:53:16.836180 3464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.811038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:37291)
0811 18:53:16.811177 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.811186 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.811596 (+ 410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.812231 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.812232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.812409 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.812559 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.812565 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.813655 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.813656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.814762 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.814765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.815317 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.815318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.815385 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.816126 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.816136 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.831269 (+ 15133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.833634 (+ 2365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.833635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.833636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.834090 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.834319 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.834320 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.834321 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.834507 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.834877 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.834886 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.835088 (+ 202us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.835675 (+ 587us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.835891 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":100,"thread_start_us":79,"threads_started":1}
I20260811 18:53:16.836411 3462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.810545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.23.226.193:34925)
0811 18:53:16.811144 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.811156 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.811553 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.811865 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.811866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.812342 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.812557 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.812563 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.813676 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.813677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.814754 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.814758 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.815205 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.815206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.815361 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.816198 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.817442 (+ 1244us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.830821 (+ 13379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.833449 (+ 2628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.833516 (+ 67us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.833522 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.834536 (+ 1014us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.834845 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.834846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.834846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.834931 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.835369 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.835370 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.835433 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.836028 (+ 595us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.836184 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":85,"thread_start_us":108,"threads_started":1}
I20260811 18:53:16.836854 3459 heartbeater.cc:347] Connected to a master server at 127.23.226.253:39153
I20260811 18:53:16.836987 3458 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41651
I20260811 18:53:16.837055 3458 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:16.837296 3458 heartbeater.cc:511] Master 127.23.226.254:41651 requested a full tablet report, sending...
I20260811 18:53:16.836993 3459 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:16.837584 3459 heartbeater.cc:511] Master 127.23.226.253:39153 requested a full tablet report, sending...
I20260811 18:53:16.837834 3461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.810545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.23.226.193:56351)
0811 18:53:16.810775 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.810828 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.811543 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.811844 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.811849 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.812342 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.812559 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.812565 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.813511 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.813512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.814769 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.814771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.815309 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.815311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.815385 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.816124 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.816136 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.831687 (+ 15551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.835191 (+ 3504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.835192 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.835193 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.835404 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.835915 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.835916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.835916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.836163 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.837212 (+ 1049us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.837212 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.837258 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.837315 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.837733 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":85,"spinlock_wait_cycles":7552,"thread_start_us":108,"threads_started":1}
I20260811 18:53:16.837831 2033 ts_manager.cc:194] Re-registered known tserver with Master: 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615)
I20260811 18:53:16.837986 2931 ts_manager.cc:194] Registered new tserver with Master: 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615)
I20260811 18:53:16.838294 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.810871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:56351 (local address 127.23.226.252:35321)
0811 18:53:16.811141 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.811144 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.811158 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:53:16.811671 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.811673 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.811689 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.811772 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.812690 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.813392 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.814868 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.815193 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.815255 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.831831 (+ 16576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.831834 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.831834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.831844 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.835097 (+ 3253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.835486 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.835488 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.835488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.835548 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.836801 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.836802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.836803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.837036 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.837182 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.837456 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.838200 (+ 744us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":105,"threads_started":1}
I20260811 18:53:16.838568 2033 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:37291
I20260811 18:53:16.839068 3456 heartbeater.cc:347] Connected to a master server at 127.23.226.252:35321
I20260811 18:53:16.839176 3456 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:16.839310 3456 heartbeater.cc:511] Master 127.23.226.252:35321 requested a full tablet report, sending...
I20260811 18:53:16.839802 3181 ts_manager.cc:194] Registered new tserver with Master: 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615)
I20260811 18:53:16.848176 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:46393
--local_ip_for_outbound_sockets=127.23.226.194
--tserver_master_addrs=127.23.226.254:41651
--webserver_port=34329
--webserver_interface=127.23.226.194
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab
--principal=oryx/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153,127.23.226.252:35321 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:16.933614 3465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:16.933858 3465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:16.933900 3465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:16.935132 3465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:16.935205 3465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:16.935248 3465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:16.936754 3465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab
--principal=oryx/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:46393
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=34329
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153,127.23.226.252:35321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:16.937022 3465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:16.937266 3465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:16.942601 3476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.942660 3475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:16.942660 3480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:16.942894 3465 server_base.cc:1034] running on GCE node
I20260811 18:53:16.943099 3465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:16.943356 3465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:16.944504 3465 hybrid_clock.cc:648] HybridClock initialized: now 1786474396944479 us; error 41 us; skew 500 ppm
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:16.947085 3465 init.cc:377] Logged in from keytab as oryx/127.23.226.194@KRBTEST.COM (short username oryx)
I20260811 18:53:16.947510 3465 webserver.cc:460] Webserver started at http://127.23.226.194:34329/ using document root <none> and password file <none>
I20260811 18:53:16.947710 3465 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:16.947767 3465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:16.949239 3465 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:16.949888 3495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.950142 3465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:16.950255 3465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "5e7bfc6f26104af786a1dd2cd1c014f0"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "527189673bd668ccdd25f3f71a0f0465"
server_key_iv: "aed8a35a10601f2e9f6ab3485b664473"
server_key_version: "encryptionkey@0"
I20260811 18:53:16.950722 3465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:16.958811 3465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:16.960986 3465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:16.961141 3465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:16.961391 3465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:16.961752 3465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:16.961808 3465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.961850 3465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:16.961876 3465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:16.968781 3465 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:46393
I20260811 18:53:16.968842 3658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:46393 every 8 connection(s)
I20260811 18:53:16.969164 3465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:16.973806 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 3465
I20260811 18:53:16.973986 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 2525
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.253@KRBTEST.COM
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.252@KRBTEST.COM
I20260811 18:53:16.980967 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.970468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:43865 (local address 127.23.226.253:39153)
0811 18:53:16.970521 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.970524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.970704 (+ 180us) server_negotiation.cc:407] Connection header received
0811 18:53:16.971285 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.971287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.971300 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.971360 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.972108 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.972879 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.974131 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.974435 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.974474 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.977725 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.977726 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.977726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.977734 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.979441 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.979923 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.979924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.979924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.979974 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.980219 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.980220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.980220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.980348 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.980387 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.980743 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.980825 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:16.981652 3667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.970339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.23.226.194:43865)
0811 18:53:16.970642 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.970654 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.970931 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.971387 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.971388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.971730 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.971985 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.971992 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.972977 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.972978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.974022 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.974025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.974616 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.974617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.974750 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.975351 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.975361 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.977623 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.979523 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.979530 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.979532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.979854 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.980040 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.980040 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.980041 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.980158 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.980424 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.980429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.980619 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.981115 (+ 496us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.981353 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":36,"thread_start_us":113,"threads_started":1}
I20260811 18:53:16.982682 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.969942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:37675 (local address 127.23.226.252:35321)
0811 18:53:16.969990 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.969993 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.970647 (+ 654us) server_negotiation.cc:407] Connection header received
0811 18:53:16.971119 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.971120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.971143 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.971219 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.972100 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.972666 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.974173 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.974613 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.974670 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.977801 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.977804 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.977804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.977815 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.980883 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.981576 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.981578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.981578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.981645 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.982021 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.982023 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.982023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.982182 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.982253 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.982473 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.982577 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:53:16.982983 3670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.969921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.23.226.194:37675)
0811 18:53:16.970567 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.970578 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.970931 (+ 353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.971245 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.971246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.971730 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.971985 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.971990 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.972793 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.972794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.974049 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.974052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.974798 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.974800 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.974902 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.975823 (+ 921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.975831 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.977667 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.981186 (+ 3519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.981187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.981187 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.981483 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.981862 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.981863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.981863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.981933 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.982283 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.982284 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.982330 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.982760 (+ 430us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.982864 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":31,"thread_start_us":103,"threads_started":1}
I20260811 18:53:16.983431 3659 heartbeater.cc:347] Connected to a master server at 127.23.226.252:35321
I20260811 18:53:16.983539 3659 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:16.983745 3659 heartbeater.cc:511] Master 127.23.226.252:35321 requested a full tablet report, sending...
I20260811 18:53:16.984230 3181 ts_manager.cc:194] Registered new tserver with Master: 5e7bfc6f26104af786a1dd2cd1c014f0 (127.23.226.194:46393)
Aug 11 18:53:16 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474396, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:16.986776 3664 heartbeater.cc:347] Connected to a master server at 127.23.226.253:39153
I20260811 18:53:16.986845 3664 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:16.986929 3664 heartbeater.cc:511] Master 127.23.226.253:39153 requested a full tablet report, sending...
I20260811 18:53:16.987331 2931 ts_manager.cc:194] Registered new tserver with Master: 5e7bfc6f26104af786a1dd2cd1c014f0 (127.23.226.194:46393)
I20260811 18:53:16.988163 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.969914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:35241 (local address 127.23.226.254:41651)
0811 18:53:16.969995 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:16.969997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:16.970325 (+ 328us) server_negotiation.cc:407] Connection header received
0811 18:53:16.971042 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:16.971043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:16.971058 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:16.971110 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:16.972119 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.972873 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.982550 (+ 9677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.982867 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.982916 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.985379 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:16.985380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:16.985381 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:16.985389 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:16.986986 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.987391 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.987392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.987393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.987455 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:16.987639 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:16.987641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:16.987641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:16.987757 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:16.987834 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:16.987997 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 18:53:16.988074 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:53:16.988183 3669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:16.969921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.194:35241)
0811 18:53:16.970155 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:16.970221 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:16.970914 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:16.971179 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:16.971183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:16.971797 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:16.971985 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.971992 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.972977 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.972978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.974022 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:16.974025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:16.983052 (+ 9027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:16.983053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:16.983170 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:16.983661 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:16.983666 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:16.985286 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:16.987130 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.987131 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.987132 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.987304 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.987516 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:16.987517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:16.987517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:16.987579 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:16.987839 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:16.987840 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:16.987883 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 18:53:16.987969 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 18:53:16.988072 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":55,"thread_start_us":107,"threads_started":1}
I20260811 18:53:16.988543 3662 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41651
I20260811 18:53:16.988607 3662 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:16.988683 3662 heartbeater.cc:511] Master 127.23.226.254:41651 requested a full tablet report, sending...
I20260811 18:53:16.988952 2033 ts_manager.cc:194] Re-registered known tserver with Master: 5e7bfc6f26104af786a1dd2cd1c014f0 (127.23.226.194:46393)
I20260811 18:53:16.989158 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:38625
--local_ip_for_outbound_sockets=127.23.226.195
--tserver_master_addrs=127.23.226.254:41651
--webserver_port=41633
--webserver_interface=127.23.226.195
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab
--principal=oryx/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153,127.23.226.252:35321 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:53:16.989552 2033 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:35241
W20260811 18:53:17.078245 3672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:17.078460 3672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:17.078485 3672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:17.079627 3672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:17.079669 3672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:17.079695 3672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:17.081184 3672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab
--principal=oryx/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:38625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=41633
--tserver_master_addrs=127.23.226.254:41651,127.23.226.253:39153,127.23.226.252:35321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:17.081400 3672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:17.081585 3672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:17.086884 3685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:17.086951 3678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:17.086894 3681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:17.087085 3672 server_base.cc:1034] running on GCE node
I20260811 18:53:17.087285 3672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:17.087519 3672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:17.088666 3672 hybrid_clock.cc:648] HybridClock initialized: now 1786474397088644 us; error 48 us; skew 500 ppm
Aug 11 18:53:17 dist-test-slave-68xk krb5kdc[1950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474397, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:17.091284 3672 init.cc:377] Logged in from keytab as oryx/127.23.226.195@KRBTEST.COM (short username oryx)
I20260811 18:53:17.091748 3672 webserver.cc:460] Webserver started at http://127.23.226.195:41633/ using document root <none> and password file <none>
I20260811 18:53:17.091975 3672 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:17.092059 3672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:17.093475 3672 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:17.094161 3698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:17.094372 3672 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:17.094498 3672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "97fcf27707494f729d8747377378bb81"
format_stamp: "Formatted at 2026-08-11 18:53:15 on dist-test-slave-68xk"
server_key: "b70190be507f936405befeb28370ff04"
server_key_iv: "789b9419b988e9c77209da14ba7dc6e9"
server_key_version: "encryptionkey@0"
I20260811 18:53:17.094887 3672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:17.106210 3672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:17.108103 3672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:17.108274 3672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:17.108538 3672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:17.108871 3672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:17.108928 3672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:17.108968 3672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:17.108994 3672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:17.115132 3672 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:38625
I20260811 18:53:17.115192 3877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:38625 every 8 connection(s)
I20260811 18:53:17.115557 3672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:53:17 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474397, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.252@KRBTEST.COM
Aug 11 18:53:17 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474397, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
Aug 11 18:53:17 dist-test-slave-68xk krb5kdc[1950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474397, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.253@KRBTEST.COM
I20260811 18:53:17.124974 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 3672
I20260811 18:53:17.127074 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.116637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:50857 (local address 127.23.226.252:35321)
0811 18:53:17.116688 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.116690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.117178 (+ 488us) server_negotiation.cc:407] Connection header received
0811 18:53:17.117296 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.117298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.117310 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.117346 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.118524 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.119236 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120127 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.120347 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120436 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.123014 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.123016 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.123016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.123024 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.125137 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.125749 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.125751 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.125752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.125826 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.126174 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.126175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.126176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.126339 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.126416 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.126839 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.126953 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:17.127589 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.116709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:40801 (local address 127.23.226.253:39153)
0811 18:53:17.116780 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.116782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.116846 (+ 64us) server_negotiation.cc:407] Connection header received
0811 18:53:17.117239 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.117241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.117255 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.117292 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.118157 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.118953 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120148 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.120454 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120496 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.124010 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.124011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.124011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.124021 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.126006 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.126576 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.126578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.126578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.126647 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.126899 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.126901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.126901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.127040 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.127089 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.127385 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.127483 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:53:17.127868 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.116585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:58433 (local address 127.23.226.254:41651)
0811 18:53:17.116644 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.116646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.116657 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:17.117218 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.117219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.117235 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.117292 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.118156 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.118754 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120147 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.120454 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120496 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.124011 (+ 3515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.124012 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.124013 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.124020 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.126033 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.126817 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.126818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.126819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.126887 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.127169 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.127171 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.127171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.127336 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.127402 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.127648 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.127732 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:53:17.128376 3886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.116324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.23.226.195:50857)
0811 18:53:17.117082 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.117116 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.117209 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.117420 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.117421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.117837 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:17.118042 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.118049 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.119337 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.119339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.120015 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.120017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.120444 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120446 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.120582 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.121143 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:17.121155 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:17.122910 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:17.125255 (+ 2345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:17.125265 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:17.125268 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:17.125632 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:17.125918 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:17.125919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:17.125919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:17.126068 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:17.126475 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:17.126484 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:17.126658 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.127478 (+ 820us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.128065 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"mutex_wait_us":30,"spinlock_wait_cycles":7552,"thread_start_us":108,"threads_started":1}
I20260811 18:53:17.129156 3879 heartbeater.cc:347] Connected to a master server at 127.23.226.252:35321
I20260811 18:53:17.129280 3879 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:17.129307 3884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.116323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:58433)
0811 18:53:17.116508 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.116550 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.117093 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.117358 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.117362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.117844 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:17.118042 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.118049 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.118864 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.118865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.120036 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.120039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.120581 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.120650 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.121533 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:17.121537 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:17.123905 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:17.126116 (+ 2211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:17.126117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:17.126118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:17.126721 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:17.126970 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:17.126971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:17.126971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:17.127043 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:17.127473 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:17.127474 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:17.127519 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.127983 (+ 464us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.129157 (+ 1174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":1110,"thread_start_us":107,"threads_started":1}
I20260811 18:53:17.129477 3879 heartbeater.cc:511] Master 127.23.226.252:35321 requested a full tablet report, sending...
I20260811 18:53:17.130048 3181 ts_manager.cc:194] Registered new tserver with Master: 97fcf27707494f729d8747377378bb81 (127.23.226.195:38625)
I20260811 18:53:17.130379 3880 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41651
I20260811 18:53:17.130472 3880 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:17.130534 3880 heartbeater.cc:511] Master 127.23.226.254:41651 requested a full tablet report, sending...
I20260811 18:53:17.130642 3885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.116324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.23.226.195:40801)
0811 18:53:17.116783 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.116795 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.117122 (+ 327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.117375 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.117376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.117835 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:17.118041 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.118046 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.119044 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.119045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.120038 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.120039 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.120583 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.120583 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.120649 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.121408 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:17.121413 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:17.123903 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:17.126108 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:17.126109 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:17.126110 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:17.126490 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:17.126745 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:17.126746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:17.126747 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:17.126816 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:17.127207 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:17.127208 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:17.127261 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.127690 (+ 429us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.129081 (+ 1391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":1250,"thread_start_us":107,"threads_started":1}
I20260811 18:53:17.130796 2033 ts_manager.cc:194] Re-registered known tserver with Master: 97fcf27707494f729d8747377378bb81 (127.23.226.195:38625)
I20260811 18:53:17.131268 2033 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:58433
I20260811 18:53:17.131695 3881 heartbeater.cc:347] Connected to a master server at 127.23.226.253:39153
I20260811 18:53:17.131803 3881 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:17.131934 3881 heartbeater.cc:511] Master 127.23.226.253:39153 requested a full tablet report, sending...
I20260811 18:53:17.132711 2931 ts_manager.cc:194] Registered new tserver with Master: 97fcf27707494f729d8747377378bb81 (127.23.226.195:38625)
I20260811 18:53:17.136626 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.128466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33992 (local address 127.23.226.252:35321)
0811 18:53:17.128504 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.128506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.128777 (+ 271us) server_negotiation.cc:407] Connection header received
0811 18:53:17.128862 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.128863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.128872 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.128898 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.129944 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.130656 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.131663 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.131936 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.131977 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.133455 (+ 1478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.133456 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.133456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.133463 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.135264 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.135671 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.135672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.135672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.135727 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.135950 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.135951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.135951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.136084 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.136171 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.136426 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.136514 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:53:17.137177 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.126347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53932 (local address 127.23.226.254:41651)
0811 18:53:17.127960 (+ 1613us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.127962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.128178 (+ 216us) server_negotiation.cc:407] Connection header received
0811 18:53:17.128302 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.128303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.128315 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.128380 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.129264 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.129790 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.131397 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.131706 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.131757 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.133351 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.133353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.133353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.133361 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.135477 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.135981 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.135983 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.135983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.136044 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.136298 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.136299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.136300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.136435 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.136533 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.137002 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.137089 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1593,"thread_start_us":119,"threads_started":1}
I20260811 18:53:17.139487 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.126663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55858 (local address 127.23.226.253:39153)
0811 18:53:17.127141 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.127143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.127314 (+ 171us) server_negotiation.cc:407] Connection header received
0811 18:53:17.127337 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.127338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.127352 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.127409 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.128390 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.133583 (+ 5193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.134638 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.135009 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.135105 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.136629 (+ 1524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.136630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.136630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.136637 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.138266 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.138673 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.138675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.138675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.138749 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.138937 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.138938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.138938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.139052 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.139160 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.139277 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.139385 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":65,"threads_started":1}
I20260811 18:53:17.138988 2033 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:17.141004 2033 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:17.149051 3149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.144800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:44615 (local address 127.0.0.1:53728)
0811 18:53:17.144864 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.144875 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.144924 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.145853 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.145853 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.145854 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:17.145875 (+ 21us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.145876 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.147103 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.147104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.148005 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.148008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.148841 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.148843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.148908 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.148912 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.148942 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.148979 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 18:53:17.149631 3912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.145007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:46393 (local address 127.0.0.1:39920)
0811 18:53:17.145255 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.145266 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.145318 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.145643 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.145644 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.145645 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:17.145684 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.145686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.146976 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.146978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.148328 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.148331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.149367 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.149369 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.149427 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.149431 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.149492 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.149536 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":1,"thread_start_us":98,"threads_started":1}
I20260811 18:53:17.149813 3909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.144927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53728 (local address 127.23.226.193:44615)
0811 18:53:17.145698 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.145702 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.145712 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:17.145752 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.145754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.145769 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.145860 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:17.145919 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.146984 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.148098 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.148737 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.149281 (+ 544us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.149338 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.149366 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.149713 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":96,"threads_started":1}
I20260811 18:53:17.149672 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.145251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39920 (local address 127.23.226.194:46393)
0811 18:53:17.145459 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.145465 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.145476 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:17.145521 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.145523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.145542 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.145638 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:17.145748 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.146864 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.148422 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.149179 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.149267 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.149330 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.149528 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.149578 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":89,"threads_started":1}
I20260811 18:53:17.150189 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.144897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:38625 (local address 127.0.0.1:58010)
0811 18:53:17.144987 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.144996 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.145055 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.146523 (+ 1468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.146524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.146526 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:17.146575 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.146577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.147875 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.147877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.148846 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.148848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.149969 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.149970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.150039 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.150044 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.150080 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.150125 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 18:53:17.150763 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.144969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58010 (local address 127.23.226.195:38625)
0811 18:53:17.145517 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.145520 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.145529 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:17.145561 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.145563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.145579 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.146528 (+ 949us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:17.146650 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.147769 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.148959 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.149850 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.150516 (+ 666us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.150594 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.150624 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.150668 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":126,"threads_started":1}
I20260811 18:53:17.150708 3365 tablet_service.cc:1467] Processing CreateTablet for tablet 5f08c1114f0d4e6e9289ffe719b3f332 (DEFAULT_TABLE table=test-table [id=94e5d47c65264542895198a153707afa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:17.150710 3563 tablet_service.cc:1467] Processing CreateTablet for tablet 5f08c1114f0d4e6e9289ffe719b3f332 (DEFAULT_TABLE table=test-table [id=94e5d47c65264542895198a153707afa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:17.151080 3563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f08c1114f0d4e6e9289ffe719b3f332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:17.151103 3365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f08c1114f0d4e6e9289ffe719b3f332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:17.154318 3914 tablet_bootstrap.cc:492] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Bootstrap starting.
I20260811 18:53:17.154687 3915 tablet_bootstrap.cc:492] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Bootstrap starting.
I20260811 18:53:17.154968 3772 tablet_service.cc:1467] Processing CreateTablet for tablet 5f08c1114f0d4e6e9289ffe719b3f332 (DEFAULT_TABLE table=test-table [id=94e5d47c65264542895198a153707afa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:17.155130 3914 tablet_bootstrap.cc:654] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:17.155320 3772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f08c1114f0d4e6e9289ffe719b3f332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:17.155381 3914 log.cc:824] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:17.155571 3915 tablet_bootstrap.cc:654] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:17.156149 3915 log.cc:824] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:17.156402 3914 tablet_bootstrap.cc:492] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: No bootstrap required, opened a new log
I20260811 18:53:17.156488 3914 ts_tablet_manager.cc:1397] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:17.157090 3915 tablet_bootstrap.cc:492] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: No bootstrap required, opened a new log
I20260811 18:53:17.157166 3915 ts_tablet_manager.cc:1397] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 18:53:17.158854 3914 raft_consensus.cc:348] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.158990 3918 tablet_bootstrap.cc:492] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Bootstrap starting.
I20260811 18:53:17.159055 3914 raft_consensus.cc:374] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:17.159116 3914 raft_consensus.cc:729] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7bfc6f26104af786a1dd2cd1c014f0, State: Initialized, Role: FOLLOWER
I20260811 18:53:17.159232 3914 consensus_queue.cc:260] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.159488 3914 ts_tablet_manager.cc:1428] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:17.159641 3662 heartbeater.cc:503] Master 127.23.226.254:41651 was elected leader, sending a full tablet report...
I20260811 18:53:17.160429 3918 tablet_bootstrap.cc:654] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:17.160772 3918 log.cc:824] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:17.160833 3915 raft_consensus.cc:348] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.161013 3915 raft_consensus.cc:374] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:17.161090 3915 raft_consensus.cc:729] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7318cee0f47143acaf4a37c441d84ee2, State: Initialized, Role: FOLLOWER
I20260811 18:53:17.161247 3915 consensus_queue.cc:260] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.161525 3915 ts_tablet_manager.cc:1428] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 18:53:17.161576 3458 heartbeater.cc:503] Master 127.23.226.254:41651 was elected leader, sending a full tablet report...
I20260811 18:53:17.163010 3918 tablet_bootstrap.cc:492] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: No bootstrap required, opened a new log
I20260811 18:53:17.163079 3918 ts_tablet_manager.cc:1397] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 18:53:17.164913 3918 raft_consensus.cc:348] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.165030 3918 raft_consensus.cc:374] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:17.165069 3918 raft_consensus.cc:729] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97fcf27707494f729d8747377378bb81, State: Initialized, Role: FOLLOWER
I20260811 18:53:17.165174 3918 consensus_queue.cc:260] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.165469 3918 ts_tablet_manager.cc:1428] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:53:17.165593 3880 heartbeater.cc:503] Master 127.23.226.254:41651 was elected leader, sending a full tablet report...
W20260811 18:53:17.219947 3665 tablet.cc:2369] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:17.269907 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.267557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33998 (local address 127.23.226.252:35321)
0811 18:53:17.267633 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.267635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.267645 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:17.267671 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.267672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.267702 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.267767 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:17.267909 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.268396 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.269251 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.269637 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.269707 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.269763 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.269821 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.269847 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:53:17.269909 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.267440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.0.0.1:33998)
0811 18:53:17.267514 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.267528 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.267586 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.267783 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.267784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.267785 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:17.267843 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.267845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.268463 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.268463 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.269171 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.269172 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.269715 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.269716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.269772 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.269776 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.269816 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.269850 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 18:53:17.270485 3217 raft_consensus.cc:1203] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 18:53:17.271456 3923 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31f61ea6c86349e0b4347eca8244742d. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:17.271574 3923 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: This master's current role is: LEARNER
W20260811 18:53:17.311755 3460 tablet.cc:2369] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:17.367832 3882 tablet.cc:2369] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:17.458372 3922 raft_consensus.cc:482] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:17.458529 3922 raft_consensus.cc:504] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.459028 3922 leader_election.cc:288] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615), 5e7bfc6f26104af786a1dd2cd1c014f0 (127.23.226.194:46393)
I20260811 18:53:17.462265 3885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.459334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:46393 (local address 127.23.226.195:40809)
0811 18:53:17.459420 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.459433 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.459501 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.459689 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.459690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.459692 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:17.459776 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.459778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.460420 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.460421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.461488 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.461491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.462024 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.462025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.462103 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.462108 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.462161 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.462199 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":5}
I20260811 18:53:17.462314 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.459409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:40809 (local address 127.23.226.194:46393)
0811 18:53:17.459458 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.459460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.459479 (+ 19us) server_negotiation.cc:407] Connection header received
0811 18:53:17.459602 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.459603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.459613 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.459675 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:17.459853 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.460347 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.461583 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.461961 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.462021 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.462054 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.462179 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.462223 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:53:17.462456 3884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.459334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:44615 (local address 127.23.226.195:37303)
0811 18:53:17.459448 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:17.459460 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:17.459504 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:17.459690 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:17.459691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:17.459692 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:17.459792 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.459793 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.460577 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.460578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.461437 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:17.461439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.462135 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.462137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:17.462233 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.462237 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:17.462297 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 18:53:17.462339 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":75}
I20260811 18:53:17.462466 3909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.459435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:37303 (local address 127.23.226.193:44615)
0811 18:53:17.459491 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.459493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.459504 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:17.459580 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.459582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.459593 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.459672 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:17.459895 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.460491 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.461521 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.462038 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.462134 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.462144 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.462321 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.462368 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:53:17.462736 3596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f08c1114f0d4e6e9289ffe719b3f332" candidate_uuid: "97fcf27707494f729d8747377378bb81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" is_pre_election: true
I20260811 18:53:17.462890 3596 raft_consensus.cc:2454] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97fcf27707494f729d8747377378bb81 in term 0.
I20260811 18:53:17.462881 3393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f08c1114f0d4e6e9289ffe719b3f332" candidate_uuid: "97fcf27707494f729d8747377378bb81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7318cee0f47143acaf4a37c441d84ee2" is_pre_election: true
I20260811 18:53:17.463058 3393 raft_consensus.cc:2454] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97fcf27707494f729d8747377378bb81 in term 0.
I20260811 18:53:17.463326 3701 leader_election.cc:302] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7bfc6f26104af786a1dd2cd1c014f0, 97fcf27707494f729d8747377378bb81; no voters:
I20260811 18:53:17.463517 3922 raft_consensus.cc:2781] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:17.463595 3922 raft_consensus.cc:482] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:17.463630 3922 raft_consensus.cc:3037] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:17.464373 3922 raft_consensus.cc:504] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.464524 3922 leader_election.cc:288] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [CANDIDATE]: Term 1 election: Requested vote from peers 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615), 5e7bfc6f26104af786a1dd2cd1c014f0 (127.23.226.194:46393)
I20260811 18:53:17.464671 3596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f08c1114f0d4e6e9289ffe719b3f332" candidate_uuid: "97fcf27707494f729d8747377378bb81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0"
I20260811 18:53:17.464766 3596 raft_consensus.cc:3037] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:17.464797 3393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f08c1114f0d4e6e9289ffe719b3f332" candidate_uuid: "97fcf27707494f729d8747377378bb81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7318cee0f47143acaf4a37c441d84ee2"
I20260811 18:53:17.464887 3393 raft_consensus.cc:3037] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:17.465534 3596 raft_consensus.cc:2454] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97fcf27707494f729d8747377378bb81 in term 1.
I20260811 18:53:17.465669 3393 raft_consensus.cc:2454] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97fcf27707494f729d8747377378bb81 in term 1.
I20260811 18:53:17.465706 3701 leader_election.cc:302] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7bfc6f26104af786a1dd2cd1c014f0, 97fcf27707494f729d8747377378bb81; no voters:
I20260811 18:53:17.465857 3922 raft_consensus.cc:2781] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:17.466048 3922 raft_consensus.cc:686] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 1 LEADER]: Becoming Leader. State: Replica: 97fcf27707494f729d8747377378bb81, State: Running, Role: LEADER
I20260811 18:53:17.466192 3922 consensus_queue.cc:237] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:17.467028 2032 catalog_manager.cc:5495] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97fcf27707494f729d8747377378bb81 (127.23.226.195). New cstate: current_term: 1 leader_uuid: "97fcf27707494f729d8747377378bb81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:17.467726 2868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: NON_VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: true } } }
I20260811 18:53:17.467823 2868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:17.468590 2868 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: attempting to promote NON_VOTER bbbe3448e43a44228511b5e50d266ef0 to VOTER
I20260811 18:53:17.468714 2868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } }
I20260811 18:53:17.469180 3216 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 LEARNER]: Refusing update from remote peer 31f61ea6c86349e0b4347eca8244742d: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 18:53:17.469341 2950 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Refusing update from remote peer 31f61ea6c86349e0b4347eca8244742d: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 18:53:17.469457 3937 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 18:53:17.469550 3934 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 18:53:17.470290 3934 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:17.470482 3216 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:17.471271 3148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:17.471359 3148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:17.471493 3934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:17.471567 3934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:17.471547 3148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:17.471608 3148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:17.471534 3923 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:17.471608 2950 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:17.471710 3923 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:17.472484 3938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31f61ea6c86349e0b4347eca8244742d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:17.472575 3938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:17.501940 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.499507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58012 (local address 127.23.226.195:38625)
0811 18:53:17.499576 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.499578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.499588 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:17.499649 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.499649 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.499669 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.499737 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:17.499874 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.500415 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.501155 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.501353 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.501418 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.501628 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:17.501743 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:17.501826 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.501848 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.501872 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:53:17.504137 3393 raft_consensus.cc:1261] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 1 FOLLOWER]: Refusing update from remote peer 97fcf27707494f729d8747377378bb81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:17.504137 3596 raft_consensus.cc:1261] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 FOLLOWER]: Refusing update from remote peer 97fcf27707494f729d8747377378bb81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:17.504563 3930 consensus_queue.cc:1035] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:17.504706 3922 consensus_queue.cc:1035] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:17.507670 3942 mvcc.cc:205] Tried to move back new op lower bound from 7317399132173701120 to 7317399132021960704. Current Snapshot: MvccSnapshot[applied={T|T < 7317399132173701120}]
I20260811 18:53:17.507858 3940 mvcc.cc:205] Tried to move back new op lower bound from 7317399132173701120 to 7317399132021960704. Current Snapshot: MvccSnapshot[applied={T|T < 7317399132173701120}]
I20260811 18:53:17.507875 3943 mvcc.cc:205] Tried to move back new op lower bound from 7317399132173701120 to 7317399132021960704. Current Snapshot: MvccSnapshot[applied={T|T < 7317399132173701120}]
I20260811 18:53:17.511090 2033 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:17.511193 2033 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:17.512655 2033 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 31f61ea6c86349e0b4347eca8244742d: Sending DeleteTablet for 3 replicas of tablet 5f08c1114f0d4e6e9289ffe719b3f332
I20260811 18:53:17.512993 3772 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f08c1114f0d4e6e9289ffe719b3f332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:17 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:58010
I20260811 18:53:17.513006 3563 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f08c1114f0d4e6e9289ffe719b3f332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:17 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:39920
I20260811 18:53:17.513432 3365 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f08c1114f0d4e6e9289ffe719b3f332 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:17 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:53728
I20260811 18:53:17.513622 3958 tablet_replica.cc:330] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: stopping tablet replica
I20260811 18:53:17.513705 3958 raft_consensus.cc:2229] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:17.513805 3958 raft_consensus.cc:2258] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:17.514353 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 1970
I20260811 18:53:17.524636 3958 ts_tablet_manager.cc:1905] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:17.526603 3958 ts_tablet_manager.cc:1918] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:17.526705 3958 log.cc:1196] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/5f08c1114f0d4e6e9289ffe719b3f332
I20260811 18:53:17.527127 3958 ts_tablet_manager.cc:1939] T 5f08c1114f0d4e6e9289ffe719b3f332 P 7318cee0f47143acaf4a37c441d84ee2: Deleting consensus metadata
I20260811 18:53:17.527948 3957 tablet_replica.cc:330] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: stopping tablet replica
I20260811 18:53:17.528179 3956 tablet_replica.cc:330] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: stopping tablet replica
I20260811 18:53:17.528357 3956 raft_consensus.cc:2229] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:17.528538 3957 raft_consensus.cc:2229] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:17.528741 3956 raft_consensus.cc:2258] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:17.528935 3957 raft_consensus.cc:2258] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:17.529561 3957 ts_tablet_manager.cc:1905] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:17.531548 3957 ts_tablet_manager.cc:1918] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:17.531629 3957 log.cc:1196] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/5f08c1114f0d4e6e9289ffe719b3f332
I20260811 18:53:17.531921 3957 ts_tablet_manager.cc:1939] T 5f08c1114f0d4e6e9289ffe719b3f332 P 97fcf27707494f729d8747377378bb81: Deleting consensus metadata
W20260811 18:53:17.533195 3702 connection.cc:535] server connection from 127.0.0.1:58010 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 18:53:17.533241 3301 connection.cc:535] server connection from 127.0.0.1:53728 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 18:53:17.536111 3956 ts_tablet_manager.cc:1905] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:17.537811 3956 ts_tablet_manager.cc:1918] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:17.537891 3956 log.cc:1196] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/5f08c1114f0d4e6e9289ffe719b3f332
I20260811 18:53:17.538149 3956 ts_tablet_manager.cc:1939] T 5f08c1114f0d4e6e9289ffe719b3f332 P 5e7bfc6f26104af786a1dd2cd1c014f0: Deleting consensus metadata
I20260811 18:53:17.539419 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.513866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34012 (local address 127.23.226.252:35321)
0811 18:53:17.513908 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.513910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.527449 (+ 13539us) server_negotiation.cc:407] Connection header received
0811 18:53:17.527510 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.527511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.527527 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.527599 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.528640 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.529463 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.530666 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.531005 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.531061 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.533506 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.533508 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.533508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.533516 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.535346 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.538485 (+ 3139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.538487 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.538487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.538556 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.538779 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.538781 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.538782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.538920 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.539009 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.539206 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.539296 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 18:53:17.539543 3499 connection.cc:441] server connection from 127.0.0.1:39920 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39920 (request call id 1) could send its response
I20260811 18:53:17.543877 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.535410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55870 (local address 127.23.226.253:39153)
0811 18:53:17.535464 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.535466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.535725 (+ 259us) server_negotiation.cc:407] Connection header received
0811 18:53:17.535828 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.535829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.535845 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.535876 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.536548 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.537285 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.538440 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.538765 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.538810 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.540870 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.540872 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.540872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.540879 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.542563 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.542964 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.542966 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.542967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.543026 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.543259 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.543260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.543260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.543400 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.543493 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.543673 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.543756 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:17.544662 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:17.535293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34020 (local address 127.23.226.252:35321)
0811 18:53:17.535450 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:17.535452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:17.535574 (+ 122us) server_negotiation.cc:407] Connection header received
0811 18:53:17.535639 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:17.535639 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:17.535654 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:17.536769 (+ 1115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:17.536807 (+ 38us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.537596 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.538791 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:17.539757 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:17.540143 (+ 386us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:17.541353 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:17.541354 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:17.541354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:17.541361 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:17.543356 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.543731 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.543733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.543733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.543792 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:17.543995 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:17.543995 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:17.543996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:17.544115 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:17.544232 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:17.544368 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 18:53:17.544453 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260811 18:53:18.509944 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:18.508936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.194:55217)
0811 18:53:18.509513 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:18.509662 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":133,"threads_started":1}
I20260811 18:53:18.509984 3979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:18.509384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:45003)
0811 18:53:18.509793 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:18.509929 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":92,"threads_started":1}
I20260811 18:53:18.510314 3978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:18.508988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:53821)
0811 18:53:18.510057 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:18.510254 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1027,"thread_start_us":85,"threads_started":1}
W20260811 18:53:18.510401 3662 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:41651 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
W20260811 18:53:18.510615 3458 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:41651 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
W20260811 18:53:18.510854 3880 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:41651 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
I20260811 18:53:19.013938 3981 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 31f61ea6c86349e0b4347eca8244742d)
I20260811 18:53:19.014043 3983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 31f61ea6c86349e0b4347eca8244742d)
I20260811 18:53:19.014261 3981 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } }
I20260811 18:53:19.014259 3983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } }
I20260811 18:53:19.015166 3981 leader_election.cc:288] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651), 6590792d2b3e4e0f9755281f349dd00f (127.23.226.253:39153)
I20260811 18:53:19.015923 3983 leader_election.cc:288] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651), bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252:35321)
I20260811 18:53:19.016152 3985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.014984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54384)
0811 18:53:19.015809 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.015905 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":71,"threads_started":1}
W20260811 18:53:19.016418 2911 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
I20260811 18:53:19.016278 3993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.015623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54400)
0811 18:53:19.016119 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.016202 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":85,"threads_started":1}
W20260811 18:53:19.016978 3173 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
I20260811 18:53:19.018764 3993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.018616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54424)
0811 18:53:19.018680 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.018725 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 18:53:19.018975 3173 leader_election.cc:334] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651): Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
I20260811 18:53:19.019927 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.017555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54410)
0811 18:53:19.019771 (+ 2216us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.019853 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2190}
W20260811 18:53:19.020076 2911 leader_election.cc:334] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651): Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
I20260811 18:53:19.020711 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.015141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55874 (local address 127.23.226.253:39153)
0811 18:53:19.015369 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:19.015371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:19.015385 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:53:19.015417 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:19.015418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:19.015430 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:19.015591 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:19.015979 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:19.017048 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:19.019176 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:19.020050 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:19.020201 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:19.020221 (+ 20us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:19.020490 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 18:53:19.020582 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":102,"threads_started":1}
I20260811 18:53:19.021087 3988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.015028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:39153 (local address 127.0.0.1:55874)
0811 18:53:19.015184 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.015208 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:19.015326 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:19.015696 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:19.015698 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:19.015702 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:19.015813 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:19.015817 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:19.017214 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:19.017215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:19.018990 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:19.018994 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:19.020284 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:19.020285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:19.020355 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:19.020360 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:19.020437 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:53:19.020924 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":378,"thread_start_us":80,"threads_started":1}
I20260811 18:53:19.021875 3985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.015465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:35321 (local address 127.0.0.1:34034)
0811 18:53:19.016322 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.016332 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:19.016421 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:19.017113 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:19.017114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:19.017117 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:19.017198 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:19.017206 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:19.018362 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:19.018364 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:19.020157 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:19.020160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:19.021438 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:19.021444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:19.021542 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:19.021554 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:53:19.021653 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 18:53:19.021744 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":85,"threads_started":1}
I20260811 18:53:19.021886 3994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.015807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34034 (local address 127.23.226.252:35321)
0811 18:53:19.016717 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:19.016721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:19.016730 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:19.016775 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:19.016776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:19.016797 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:19.017009 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:19.017367 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:19.018197 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:19.020327 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:19.021217 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:19.021313 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:19.021329 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:19.021669 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 18:53:19.021755 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":878,"thread_start_us":83,"threads_started":1}
I20260811 18:53:19.022274 3216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6590792d2b3e4e0f9755281f349dd00f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bbbe3448e43a44228511b5e50d266ef0" is_pre_election: true
I20260811 18:53:19.022516 3216 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6590792d2b3e4e0f9755281f349dd00f in term 1.
I20260811 18:53:19.022562 2950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bbbe3448e43a44228511b5e50d266ef0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6590792d2b3e4e0f9755281f349dd00f" is_pre_election: true
I20260811 18:53:19.022704 2950 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbbe3448e43a44228511b5e50d266ef0 in term 1.
I20260811 18:53:19.022775 2910 leader_election.cc:302] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6590792d2b3e4e0f9755281f349dd00f, bbbe3448e43a44228511b5e50d266ef0; no voters: 31f61ea6c86349e0b4347eca8244742d
I20260811 18:53:19.022987 3983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 18:53:19.022953 3175 leader_election.cc:302] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6590792d2b3e4e0f9755281f349dd00f, bbbe3448e43a44228511b5e50d266ef0; no voters: 31f61ea6c86349e0b4347eca8244742d
I20260811 18:53:19.023070 3983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 31f61ea6c86349e0b4347eca8244742d)
I20260811 18:53:19.023133 3983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:53:19.023187 3981 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 18:53:19.023253 3981 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 31f61ea6c86349e0b4347eca8244742d)
I20260811 18:53:19.023329 3981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:53:19.024277 3983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } }
I20260811 18:53:19.024372 3981 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } }
I20260811 18:53:19.024519 3983 leader_election.cc:288] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [CANDIDATE]: Term 2 election: Requested vote from peers 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651), bbbe3448e43a44228511b5e50d266ef0 (127.23.226.252:35321)
I20260811 18:53:19.024642 3981 leader_election.cc:288] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 2 election: Requested vote from peers 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651), 6590792d2b3e4e0f9755281f349dd00f (127.23.226.253:39153)
I20260811 18:53:19.024833 3216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6590792d2b3e4e0f9755281f349dd00f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bbbe3448e43a44228511b5e50d266ef0"
I20260811 18:53:19.024991 3216 raft_consensus.cc:2379] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6590792d2b3e4e0f9755281f349dd00f in current term 2: Already voted for candidate bbbe3448e43a44228511b5e50d266ef0 in this term.
I20260811 18:53:19.024912 3985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.024641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54436)
0811 18:53:19.024809 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.024857 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260811 18:53:19.025103 3988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.024759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54444)
0811 18:53:19.024995 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.025059 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
I20260811 18:53:19.025019 2950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bbbe3448e43a44228511b5e50d266ef0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6590792d2b3e4e0f9755281f349dd00f"
I20260811 18:53:19.025461 2950 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bbbe3448e43a44228511b5e50d266ef0 in current term 2: Already voted for candidate 6590792d2b3e4e0f9755281f349dd00f in this term.
I20260811 18:53:19.025708 3985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.025576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54448)
0811 18:53:19.025613 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.025659 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 18:53:19.025811 3988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.025669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54450)
0811 18:53:19.025732 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.025770 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 18:53:19.025906 3173 leader_election.cc:334] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651): Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
W20260811 18:53:19.025955 2911 leader_election.cc:334] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651): Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
I20260811 18:53:19.025974 3173 leader_election.cc:302] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbbe3448e43a44228511b5e50d266ef0; no voters: 31f61ea6c86349e0b4347eca8244742d, 6590792d2b3e4e0f9755281f349dd00f
I20260811 18:53:19.026007 2911 leader_election.cc:302] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6590792d2b3e4e0f9755281f349dd00f; no voters: 31f61ea6c86349e0b4347eca8244742d, bbbe3448e43a44228511b5e50d266ef0
I20260811 18:53:19.026144 3983 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 18:53:19.026129 3981 raft_consensus.cc:2726] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 18:53:19.511454 3999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.511075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:51925)
0811 18:53:19.511286 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.511349 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":111,"threads_started":1}
I20260811 18:53:19.511646 4000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.511288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:40737)
0811 18:53:19.511489 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.511553 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":93,"threads_started":1}
I20260811 18:53:19.511998 3997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:19.510882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.194:38339)
0811 18:53:19.511856 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:19.511921 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":944,"thread_start_us":101,"threads_started":1}
I20260811 18:53:20.512463 4002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.512166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:34963)
0811 18:53:20.512359 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.512405 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":107,"threads_started":1}
I20260811 18:53:20.512548 4003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.512233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:58525)
0811 18:53:20.512467 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.512503 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":82,"threads_started":1}
I20260811 18:53:20.512684 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.512475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.194:43911)
0811 18:53:20.512582 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.512635 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":48,"threads_started":1}
I20260811 18:53:20.735471 4005 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:20.735572 4005 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } }
I20260811 18:53:20.735781 4005 leader_election.cc:288] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651), 6590792d2b3e4e0f9755281f349dd00f (127.23.226.253:39153)
I20260811 18:53:20.736069 2950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bbbe3448e43a44228511b5e50d266ef0" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6590792d2b3e4e0f9755281f349dd00f" is_pre_election: true
I20260811 18:53:20.736181 2950 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbbe3448e43a44228511b5e50d266ef0 in term 2.
I20260811 18:53:20.736150 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.735918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54694)
0811 18:53:20.736065 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.736106 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260811 18:53:20.736373 3175 leader_election.cc:302] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6590792d2b3e4e0f9755281f349dd00f, bbbe3448e43a44228511b5e50d266ef0; no voters:
I20260811 18:53:20.736485 4005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 18:53:20.736593 4005 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:20.736639 4005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:53:20.736758 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.736623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54700)
0811 18:53:20.736689 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.736734 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 18:53:20.736868 3173 leader_election.cc:334] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651): Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
I20260811 18:53:20.737484 4005 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } }
I20260811 18:53:20.737633 4005 leader_election.cc:288] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 3 election: Requested vote from peers 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651), 6590792d2b3e4e0f9755281f349dd00f (127.23.226.253:39153)
I20260811 18:53:20.737820 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.737706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54710)
0811 18:53:20.737755 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.737791 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 18:53:20.737855 2950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bbbe3448e43a44228511b5e50d266ef0" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6590792d2b3e4e0f9755281f349dd00f"
I20260811 18:53:20.737946 2950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:53:20.738255 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.738100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54722)
0811 18:53:20.738196 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.738232 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260811 18:53:20.738335 3173 leader_election.cc:334] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651): Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
I20260811 18:53:20.738907 2950 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbbe3448e43a44228511b5e50d266ef0 in term 3.
I20260811 18:53:20.739076 3175 leader_election.cc:302] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6590792d2b3e4e0f9755281f349dd00f, bbbe3448e43a44228511b5e50d266ef0; no voters: 31f61ea6c86349e0b4347eca8244742d
I20260811 18:53:20.739187 4005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 18:53:20.739312 4005 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [term 3 LEADER]: Becoming Leader. State: Replica: bbbe3448e43a44228511b5e50d266ef0, State: Running, Role: LEADER
I20260811 18:53:20.739398 4005 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } }
I20260811 18:53:20.739784 4008 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbbe3448e43a44228511b5e50d266ef0. Latest consensus state: current_term: 3 leader_uuid: "bbbe3448e43a44228511b5e50d266ef0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:20.739888 4008 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:20.740202 4011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:20.740650 4011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:20.740741 4011 catalog_manager.cc:1259] Loaded cluster ID: 8c2d940235c34ecd8de7a3c49e12889c
I20260811 18:53:20.740779 4011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:20.740984 4011 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:20.741086 4011 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Loaded TSK: 0
I20260811 18:53:20.741274 4011 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:20.804275 3181 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:20.806038 3181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:20.807308 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.807166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54740)
0811 18:53:20.807232 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.807272 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 18:53:20.807361 2950 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [term 3 FOLLOWER]: Refusing update from remote peer bbbe3448e43a44228511b5e50d266ef0: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 18:53:20.807652 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.807568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.0.0.1:54744)
0811 18:53:20.807607 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.807631 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 18:53:20.807611 4005 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 18:53:20.807717 3173 consensus_peers.cc:487] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 -> Peer 31f61ea6c86349e0b4347eca8244742d (127.23.226.254:41651): Couldn't send request to peer 31f61ea6c86349e0b4347eca8244742d. Status: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 18:53:20.808470 4015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbbe3448e43a44228511b5e50d266ef0. Latest consensus state: current_term: 3 leader_uuid: "bbbe3448e43a44228511b5e50d266ef0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:20.808636 4015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:20.809326 4015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "bbbe3448e43a44228511b5e50d266ef0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:20.809465 4015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6590792d2b3e4e0f9755281f349dd00f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:53:20.809698 4008 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "bbbe3448e43a44228511b5e50d266ef0" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "31f61ea6c86349e0b4347eca8244742d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41651 } } peers { permanent_uuid: "6590792d2b3e4e0f9755281f349dd00f" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 39153 } attrs { promote: false } } peers { permanent_uuid: "bbbe3448e43a44228511b5e50d266ef0" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 35321 } attrs { promote: false } } }
I20260811 18:53:20.809803 4008 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:20.810688 4016 mvcc.cc:205] Tried to move back new op lower bound from 7317399145704361984 to 7317399145429225472. Current Snapshot: MvccSnapshot[applied={T|T < 7317399145704361984 or (T in {7317399145704361984})}]
I20260811 18:53:20.815956 4024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.813003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58028 (local address 127.23.226.195:38625)
0811 18:53:20.813121 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:20.813122 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:20.813165 (+ 43us) server_negotiation.cc:407] Connection header received
0811 18:53:20.813281 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:20.813282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:20.813293 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:20.813366 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:20.813509 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.814291 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.815228 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.815614 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.815701 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.815710 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:20.815847 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 18:53:20.815888 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":63,"threads_started":1}
I20260811 18:53:20.815966 4023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.812930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:38625 (local address 127.0.0.1:58028)
0811 18:53:20.813053 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.813065 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:20.813184 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:20.813387 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:20.813388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:20.813390 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:20.813436 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.813437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.814353 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.814354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.815133 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.815135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.815697 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.815698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.815760 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.815764 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:20.815841 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:53:20.815883 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":79,"threads_started":1}
I20260811 18:53:20.816371 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.812791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:44615 (local address 127.0.0.1:53732)
0811 18:53:20.812825 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.812835 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:20.812885 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:20.813191 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:20.813193 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:20.813195 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:20.813261 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.813263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.814253 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.814254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.815430 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.815432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.816178 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.816179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.816238 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.816241 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:20.816269 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 18:53:20.816306 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 18:53:20.816490 3772 tablet_service.cc:1467] Processing CreateTablet for tablet cda1d1df067f4064b4b6ab58b6d5bcc5 (DEFAULT_TABLE table=test-table [id=28adf232babe4a98ad05ecee01fad5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:20.816623 4022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.812891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53732 (local address 127.23.226.193:44615)
0811 18:53:20.813040 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:20.813042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:20.813051 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:20.813080 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:20.813081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:20.813094 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:20.813331 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:20.813377 (+ 46us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.814152 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.815533 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.816088 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.816475 (+ 387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.816484 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:20.816509 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 18:53:20.816549 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260811 18:53:20.816651 3772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cda1d1df067f4064b4b6ab58b6d5bcc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:20.816888 3365 tablet_service.cc:1467] Processing CreateTablet for tablet cda1d1df067f4064b4b6ab58b6d5bcc5 (DEFAULT_TABLE table=test-table [id=28adf232babe4a98ad05ecee01fad5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:20.817010 3365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cda1d1df067f4064b4b6ab58b6d5bcc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:20.818353 4029 tablet_bootstrap.cc:492] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: Bootstrap starting.
I20260811 18:53:20.818670 4030 tablet_bootstrap.cc:492] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2: Bootstrap starting.
I20260811 18:53:20.818861 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.813116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:46393 (local address 127.0.0.1:39930)
0811 18:53:20.813231 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.813243 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:20.813423 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:20.813645 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:20.813646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:20.813648 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:20.813691 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.813693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.814699 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.814700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.815769 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.815771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.818591 (+ 2820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.818592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.818659 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.818665 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 18:53:20.818735 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:53:20.818777 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":77,"threads_started":1}
I20260811 18:53:20.818884 4028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.813323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39930 (local address 127.23.226.194:46393)
0811 18:53:20.813514 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:20.813516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:20.813522 (+ 6us) server_negotiation.cc:407] Connection header received
0811 18:53:20.813548 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:20.813549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:20.813559 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:20.813622 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:20.813776 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.814602 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.815862 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.818520 (+ 2658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.818595 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.818604 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:20.818755 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 18:53:20.818805 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":68,"threads_started":1}
I20260811 18:53:20.818979 4029 tablet_bootstrap.cc:654] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:20.819329 4030 tablet_bootstrap.cc:654] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:20.819334 3563 tablet_service.cc:1467] Processing CreateTablet for tablet cda1d1df067f4064b4b6ab58b6d5bcc5 (DEFAULT_TABLE table=test-table [id=28adf232babe4a98ad05ecee01fad5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:20.819453 3563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cda1d1df067f4064b4b6ab58b6d5bcc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:20.820055 4030 tablet_bootstrap.cc:492] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2: No bootstrap required, opened a new log
I20260811 18:53:20.820123 4030 ts_tablet_manager.cc:1397] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:20.820307 4030 raft_consensus.cc:348] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.820386 4030 raft_consensus.cc:374] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:20.820407 4030 raft_consensus.cc:729] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7318cee0f47143acaf4a37c441d84ee2, State: Initialized, Role: FOLLOWER
I20260811 18:53:20.820472 4030 consensus_queue.cc:260] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.820657 4030 ts_tablet_manager.cc:1428] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:20.820930 4003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.820828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:35963)
0811 18:53:20.820873 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.820901 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 18:53:20.821141 4035 tablet_bootstrap.cc:492] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0: Bootstrap starting.
I20260811 18:53:20.821436 3456 heartbeater.cc:503] Master 127.23.226.252:35321 was elected leader, sending a full tablet report...
I20260811 18:53:20.821461 4029 tablet_bootstrap.cc:492] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: No bootstrap required, opened a new log
I20260811 18:53:20.821513 4029 ts_tablet_manager.cc:1397] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 18:53:20.821519 4035 tablet_bootstrap.cc:654] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:20.821640 4029 raft_consensus.cc:348] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.821717 4029 raft_consensus.cc:374] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:20.821741 4029 raft_consensus.cc:729] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97fcf27707494f729d8747377378bb81, State: Initialized, Role: FOLLOWER
I20260811 18:53:20.821786 4029 consensus_queue.cc:260] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.821952 4029 ts_tablet_manager.cc:1428] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:20.822223 4035 tablet_bootstrap.cc:492] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0: No bootstrap required, opened a new log
I20260811 18:53:20.822252 4002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.822147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:37835)
0811 18:53:20.822194 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.822220 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 18:53:20.822270 4035 ts_tablet_manager.cc:1397] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:20.822371 4003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.821390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:48095)
0811 18:53:20.822300 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.822331 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":891}
I20260811 18:53:20.822467 4035 raft_consensus.cc:348] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.822582 4035 raft_consensus.cc:374] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:20.822610 4035 raft_consensus.cc:729] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7bfc6f26104af786a1dd2cd1c014f0, State: Initialized, Role: FOLLOWER
I20260811 18:53:20.822629 3879 heartbeater.cc:503] Master 127.23.226.252:35321 was elected leader, sending a full tablet report...
I20260811 18:53:20.822682 4035 consensus_queue.cc:260] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.822739 4002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.822657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:59889)
0811 18:53:20.822694 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.822717 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 18:53:20.822875 4035 ts_tablet_manager.cc:1428] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:20.823215 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.823083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.194:53703)
0811 18:53:20.823152 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.823187 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 18:53:20.838008 4042 raft_consensus.cc:482] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:20.838107 4042 raft_consensus.cc:504] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.838550 4042 leader_election.cc:288] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615), 97fcf27707494f729d8747377378bb81 (127.23.226.195:38625)
I20260811 18:53:20.841878 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.838719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:38625 (local address 127.23.226.194:50869)
0811 18:53:20.839007 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.839021 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:20.839096 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:20.839243 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:20.839244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:20.839246 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:20.839309 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.839311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.839960 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.839961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.840884 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.840887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.841613 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.841614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.841703 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.841708 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:20.841776 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 18:53:20.841810 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":112,"thread_start_us":115,"threads_started":1}
I20260811 18:53:20.841925 4024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.838834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:50869 (local address 127.23.226.195:38625)
0811 18:53:20.838900 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:20.838903 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:20.839104 (+ 201us) server_negotiation.cc:407] Connection header received
0811 18:53:20.839171 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:20.839172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:20.839184 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:20.839238 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:20.839379 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.839869 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.841013 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.841486 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.841581 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.841595 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:20.841794 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 18:53:20.841837 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:53:20.842077 4022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.838800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:49955 (local address 127.23.226.193:44615)
0811 18:53:20.838868 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:20.838871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:20.838885 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:53:20.838923 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:20.838924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:20.838935 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:20.839018 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:20.839216 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.839817 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.840976 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.841638 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.841712 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.841723 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:20.841936 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 18:53:20.841982 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:53:20.842020 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.838710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:44615 (local address 127.23.226.194:49955)
0811 18:53:20.838786 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.838799 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:20.838858 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:20.839022 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:20.839024 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:20.839026 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:20.839129 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.839131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.839901 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.839902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.840877 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:20.840879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.841729 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.841730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:20.841844 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.841847 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:20.841907 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 18:53:20.841947 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:53:20.842371 3393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cda1d1df067f4064b4b6ab58b6d5bcc5" candidate_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7318cee0f47143acaf4a37c441d84ee2" is_pre_election: true
I20260811 18:53:20.842507 3393 raft_consensus.cc:2454] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7bfc6f26104af786a1dd2cd1c014f0 in term 0.
I20260811 18:53:20.842492 3803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cda1d1df067f4064b4b6ab58b6d5bcc5" candidate_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97fcf27707494f729d8747377378bb81" is_pre_election: true
I20260811 18:53:20.842644 3803 raft_consensus.cc:2454] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7bfc6f26104af786a1dd2cd1c014f0 in term 0.
I20260811 18:53:20.842710 3499 leader_election.cc:302] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7bfc6f26104af786a1dd2cd1c014f0, 7318cee0f47143acaf4a37c441d84ee2; no voters:
I20260811 18:53:20.842864 4042 raft_consensus.cc:2781] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:20.842916 4042 raft_consensus.cc:482] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:20.842931 4042 raft_consensus.cc:3037] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:20.843619 4042 raft_consensus.cc:504] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.843757 4042 leader_election.cc:288] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615), 97fcf27707494f729d8747377378bb81 (127.23.226.195:38625)
I20260811 18:53:20.843952 3393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cda1d1df067f4064b4b6ab58b6d5bcc5" candidate_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7318cee0f47143acaf4a37c441d84ee2"
I20260811 18:53:20.844041 3393 raft_consensus.cc:3037] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:20.844076 3803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cda1d1df067f4064b4b6ab58b6d5bcc5" candidate_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97fcf27707494f729d8747377378bb81"
I20260811 18:53:20.844156 3803 raft_consensus.cc:3037] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:20.844731 3393 raft_consensus.cc:2454] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7bfc6f26104af786a1dd2cd1c014f0 in term 1.
I20260811 18:53:20.844837 3803 raft_consensus.cc:2454] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7bfc6f26104af786a1dd2cd1c014f0 in term 1.
I20260811 18:53:20.844916 3499 leader_election.cc:302] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7bfc6f26104af786a1dd2cd1c014f0, 7318cee0f47143acaf4a37c441d84ee2; no voters:
I20260811 18:53:20.845001 4042 raft_consensus.cc:2781] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:20.845161 4042 raft_consensus.cc:686] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7bfc6f26104af786a1dd2cd1c014f0, State: Running, Role: LEADER
I20260811 18:53:20.845219 4042 consensus_queue.cc:237] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } }
I20260811 18:53:20.845306 3659 heartbeater.cc:503] Master 127.23.226.252:35321 was elected leader, sending a full tablet report...
I20260811 18:53:20.845507 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.845416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.194:53757)
0811 18:53:20.845448 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.845479 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 18:53:20.845990 3203 catalog_manager.cc:5495] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7bfc6f26104af786a1dd2cd1c014f0 (127.23.226.194). New cstate: current_term: 1 leader_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e7bfc6f26104af786a1dd2cd1c014f0" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46393 } health_report { overall_health: HEALTHY } } }
I20260811 18:53:20.853760 4028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.851331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39940 (local address 127.23.226.194:46393)
0811 18:53:20.851375 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:20.851377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:20.851384 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:53:20.851424 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:20.851424 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:20.851441 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:20.851525 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:20.851655 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.852136 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.852895 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:20.853168 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:20.853245 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:20.853412 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:20.853526 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:20.853608 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:20.853661 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 18:53:20.853681 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:20.854974 3393 raft_consensus.cc:1261] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2 [term 1 FOLLOWER]: Refusing update from remote peer 5e7bfc6f26104af786a1dd2cd1c014f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:20.855085 3803 raft_consensus.cc:1261] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 1 FOLLOWER]: Refusing update from remote peer 5e7bfc6f26104af786a1dd2cd1c014f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:20.855232 4042 consensus_queue.cc:1035] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7318cee0f47143acaf4a37c441d84ee2" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 44615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:20.855389 4044 consensus_queue.cc:1035] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97fcf27707494f729d8747377378bb81" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:20.855963 4003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.855852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:36877)
0811 18:53:20.855887 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.855928 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 18:53:20.856209 4002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.856098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:39169)
0811 18:53:20.856143 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.856172 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 18:53:20.857582 4002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.857483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.195:46219)
0811 18:53:20.857521 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.857555 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 18:53:20.857656 4003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.857562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.193:57721)
0811 18:53:20.857602 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.857625 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 18:53:20.858140 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.858033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41651 (local address 127.23.226.194:39113)
0811 18:53:20.858088 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.858113 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:41651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 18:53:20.860522 3201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:20.860615 3201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:20.861910 3201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbbe3448e43a44228511b5e50d266ef0: Sending DeleteTablet for 3 replicas of tablet cda1d1df067f4064b4b6ab58b6d5bcc5
I20260811 18:53:20.862234 3772 tablet_service.cc:1514] Processing DeleteTablet for tablet cda1d1df067f4064b4b6ab58b6d5bcc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:20 UTC) from {username='oryx', principal='oryx/127.23.226.252@KRBTEST.COM'} at 127.0.0.1:58028
I20260811 18:53:20.862233 3563 tablet_service.cc:1514] Processing DeleteTablet for tablet cda1d1df067f4064b4b6ab58b6d5bcc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:20 UTC) from {username='oryx', principal='oryx/127.23.226.252@KRBTEST.COM'} at 127.0.0.1:39930
I20260811 18:53:20.862679 3365 tablet_service.cc:1514] Processing DeleteTablet for tablet cda1d1df067f4064b4b6ab58b6d5bcc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:20 UTC) from {username='oryx', principal='oryx/127.23.226.252@KRBTEST.COM'} at 127.0.0.1:53732
I20260811 18:53:20.862910 4064 tablet_replica.cc:330] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 7318cee0f47143acaf4a37c441d84ee2: stopping tablet replica
I20260811 18:53:20.862926 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 3145
I20260811 18:53:20.867537 4063 tablet_replica.cc:330] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: stopping tablet replica
I20260811 18:53:20.867676 4063 raft_consensus.cc:2229] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:20.867790 4063 raft_consensus.cc:2258] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:20.867964 4062 tablet_replica.cc:330] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0: stopping tablet replica
I20260811 18:53:20.868057 4062 raft_consensus.cc:2229] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:20.868201 4062 raft_consensus.cc:2258] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:20.871057 4063 ts_tablet_manager.cc:1905] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:20.872975 4063 ts_tablet_manager.cc:1918] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:20.873062 4063 log.cc:1196] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/cda1d1df067f4064b4b6ab58b6d5bcc5
I20260811 18:53:20.873389 4063 ts_tablet_manager.cc:1939] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 97fcf27707494f729d8747377378bb81: Deleting consensus metadata
I20260811 18:53:20.873764 3173 catalog_manager.cc:4841] TS 97fcf27707494f729d8747377378bb81 (127.23.226.195:38625): tablet cda1d1df067f4064b4b6ab58b6d5bcc5 (table test-table [id=28adf232babe4a98ad05ecee01fad5b8]) successfully deleted
I20260811 18:53:20.878947 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.878809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:44615 (local address 127.0.0.1:53746)
0811 18:53:20.878864 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.878894 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:44615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 18:53:20.879035 4062 ts_tablet_manager.cc:1905] T cda1d1df067f4064b4b6ab58b6d5bcc5 P 5e7bfc6f26104af786a1dd2cd1c014f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:20.879072 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 3465
W20260811 18:53:20.884105 3175 catalog_manager.cc:4584] TS 7318cee0f47143acaf4a37c441d84ee2 (127.23.226.193:44615): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cda1d1df067f4064b4b6ab58b6d5bcc5: Network error: Client connection negotiation failed: client connection to 127.23.226.193:44615: connect: Connection refused (error 111)
I20260811 18:53:20.894632 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 3672
I20260811 18:53:20.894624 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:20.894322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:46393 (local address 127.0.0.1:39942)
0811 18:53:20.894396 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:20.894576 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.194:46393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:53:20.906704 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 2726
I20260811 18:53:20.919201 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 3008
2026-08-11T18:53:20Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6986 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:20 dist-test-slave-68xk krb5kdc[4067](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:20 dist-test-slave-68xk krb5kdc[4067](info): set up 2 sockets
Aug 11 18:53:20 dist-test-slave-68xk krb5kdc[4067](info): commencing operation
krb5kdc: starting...
W20260811 18:53:22.186791 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:22Z Disabled control of system clock
WARNING: no policy specified for oryx/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.254.keytab.
Entry for principal oryx/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.254.keytab.
I20260811 18:53:22.317452 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:43063
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.254.keytab
--principal=oryx/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:43063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:22.402158 4085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:22.402364 4085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:22.402388 4085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:22.403556 4085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:22.403599 4085 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 18:53:22.403613 4085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:22.403626 4085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:22.403640 4085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:22.403651 4085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:22.405076 4085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:43063
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.254.keytab
--principal=oryx/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:43063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:22.405274 4085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:22.405441 4085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:53:22.410640 4085 server_base.cc:1034] running on GCE node
W20260811 18:53:22.410614 4091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:22.410655 4092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:22.410614 4100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:22.411231 4085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:22.411545 4085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:22.412719 4085 hybrid_clock.cc:648] HybridClock initialized: now 1786474402412702 us; error 31 us; skew 500 ppm
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:22.415373 4085 init.cc:377] Logged in from keytab as oryx/127.23.226.254@KRBTEST.COM (short username oryx)
I20260811 18:53:22.415853 4085 webserver.cc:460] Webserver started at http://127.23.226.254:38183/ using document root <none> and password file <none>
I20260811 18:53:22.416079 4085 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:22.416150 4085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:22.416308 4085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:22.417369 4085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "a12edc6ed13b46e8a1896039e4022d34"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "a40cb6cf48a619f84e8abc94c4821b58"
server_key_iv: "53a5d0560491c0e5bfd4f98fe58eaa7e"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.417749 4085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "a12edc6ed13b46e8a1896039e4022d34"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "a40cb6cf48a619f84e8abc94c4821b58"
server_key_iv: "53a5d0560491c0e5bfd4f98fe58eaa7e"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.419212 4085 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:22.419994 4109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.420184 4085 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:22.420300 4085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "a12edc6ed13b46e8a1896039e4022d34"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "a40cb6cf48a619f84e8abc94c4821b58"
server_key_iv: "53a5d0560491c0e5bfd4f98fe58eaa7e"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.420378 4085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:22.440245 4085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:22.442353 4085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:22.442545 4085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:22.447856 4085 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:43063
I20260811 18:53:22.447913 4206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:43063 every 8 connection(s)
I20260811 18:53:22.448288 4085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:22.449097 4207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:22.451447 4207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: Bootstrap starting.
I20260811 18:53:22.452106 4207 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:22.452375 4207 log.cc:824] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:22.453037 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 4085
I20260811 18:53:22.453151 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:22.453156 4207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: No bootstrap required, opened a new log
I20260811 18:53:22.453377 24459 external_mini_cluster.cc:1428] Setting key 8e269ce5628c33d264a096beeea83172
I20260811 18:53:22.456208 4207 raft_consensus.cc:348] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12edc6ed13b46e8a1896039e4022d34" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43063 } }
I20260811 18:53:22.456372 4207 raft_consensus.cc:374] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:22.456399 4207 raft_consensus.cc:729] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a12edc6ed13b46e8a1896039e4022d34, State: Initialized, Role: FOLLOWER
I20260811 18:53:22.456538 4207 consensus_queue.cc:260] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12edc6ed13b46e8a1896039e4022d34" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43063 } }
I20260811 18:53:22.456617 4207 raft_consensus.cc:388] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:22.456662 4207 raft_consensus.cc:482] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:22.456712 4207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:22.457456 4207 raft_consensus.cc:504] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12edc6ed13b46e8a1896039e4022d34" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43063 } }
I20260811 18:53:22.457571 4207 leader_election.cc:302] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a12edc6ed13b46e8a1896039e4022d34; no voters:
I20260811 18:53:22.457727 4207 leader_election.cc:288] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:22.457798 4213 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:22.457945 4213 raft_consensus.cc:686] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [term 1 LEADER]: Becoming Leader. State: Replica: a12edc6ed13b46e8a1896039e4022d34, State: Running, Role: LEADER
I20260811 18:53:22.457998 4207 sys_catalog.cc:564] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:22.458124 4213 consensus_queue.cc:237] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12edc6ed13b46e8a1896039e4022d34" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43063 } }
I20260811 18:53:22.459570 4216 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a12edc6ed13b46e8a1896039e4022d34. Latest consensus state: current_term: 1 leader_uuid: "a12edc6ed13b46e8a1896039e4022d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12edc6ed13b46e8a1896039e4022d34" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43063 } } }
I20260811 18:53:22.459676 4216 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:22.459952 4215 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a12edc6ed13b46e8a1896039e4022d34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12edc6ed13b46e8a1896039e4022d34" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 43063 } } }
I20260811 18:53:22.460021 4215 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34 [sys.catalog]: This master's current role is: LEADER
W20260811 18:53:22.460184 4234 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:53:22.460245 4234 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:53:22.460301 4236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:22.460481 4236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:22.462178 4236 catalog_manager.cc:1347] Generated new cluster ID: 5a5a5ff6e26847ab81bf0a6b6cff610c
I20260811 18:53:22.462257 4236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:22.465662 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.453943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59784 (local address 127.23.226.254:43063)
0811 18:53:22.454136 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:22.454144 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:22.454169 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:53:22.454637 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:22.454644 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:22.454692 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:22.454810 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:22.455753 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.456834 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.457956 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.458593 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.458746 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.461744 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:22.461748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:22.461749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:22.461762 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:22.463864 (+ 2102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.464287 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.464290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.464290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.464391 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.464616 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.464617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.464617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.464913 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:22.465065 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:22.465291 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 18:53:22.465421 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":87,"threads_started":1}
I20260811 18:53:22.468132 4236 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:22.468609 4236 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:22.470939 4236 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: Generated new TSK 0
I20260811 18:53:22.471094 4236 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab.
Entry for principal oryx/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab.
I20260811 18:53:22.503777 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43063
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab
--principal=oryx/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:22.588466 4244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:22.588673 4244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:22.588697 4244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:22.589773 4244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:22.589807 4244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:22.589828 4244 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:22.589844 4244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:22.591382 4244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab
--principal=oryx/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:43063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:22.591567 4244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:22.591753 4244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:22.596846 4256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:22.596840 4253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:22.596840 4258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:22.597028 4244 server_base.cc:1034] running on GCE node
I20260811 18:53:22.597409 4244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:22.597657 4244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:22.598843 4244 hybrid_clock.cc:648] HybridClock initialized: now 1786474402598819 us; error 36 us; skew 500 ppm
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:22.601455 4244 init.cc:377] Logged in from keytab as oryx/127.23.226.193@KRBTEST.COM (short username oryx)
I20260811 18:53:22.601946 4244 webserver.cc:460] Webserver started at http://127.23.226.193:35365/ using document root <none> and password file <none>
I20260811 18:53:22.602180 4244 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:22.602259 4244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:22.602451 4244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:22.603493 4244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "fa6c5d7a19ad44a8a50dd01f768149d9"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "1d486fedccba54092214e8ba3a561e23"
server_key_iv: "e3922003ee6f8b4812ad7fa8c7ed890b"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.603871 4244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "fa6c5d7a19ad44a8a50dd01f768149d9"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "1d486fedccba54092214e8ba3a561e23"
server_key_iv: "e3922003ee6f8b4812ad7fa8c7ed890b"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.605258 4244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:53:22.606038 4267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.606217 4244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:22.606343 4244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "fa6c5d7a19ad44a8a50dd01f768149d9"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "1d486fedccba54092214e8ba3a561e23"
server_key_iv: "e3922003ee6f8b4812ad7fa8c7ed890b"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.606443 4244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:22.625172 4244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:22.627650 4244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:22.627830 4244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:22.628396 4244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:22.628464 4244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.628510 4244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:22.628556 4244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:22.636394 4244 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:34749
I20260811 18:53:22.636795 4450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:34749 every 8 connection(s)
I20260811 18:53:22.636832 4244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:22.638857 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.629052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:51291 (local address 127.23.226.254:43063)
0811 18:53:22.629135 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:22.629137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:22.629382 (+ 245us) server_negotiation.cc:407] Connection header received
0811 18:53:22.629985 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:22.629986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:22.630000 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:22.630084 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:22.631138 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.631660 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.632760 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.632980 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.633070 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.635812 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:22.635814 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:22.635814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:22.635822 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:22.637577 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.637954 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.637955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.637955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.638010 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.638265 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.638265 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.638266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.638367 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:22.638461 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:22.638709 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 18:53:22.638793 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:53:22.639015 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.629034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43063 (local address 127.23.226.193:51291)
0811 18:53:22.629231 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:22.629275 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:22.629870 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:22.630222 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:22.630227 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:22.630680 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:22.631006 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.631012 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.631774 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.631775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.632660 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.632664 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.633072 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.633073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.633223 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.633761 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:22.633771 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:22.635730 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:22.637653 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.637660 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.637661 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.637882 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.638067 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.638068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.638068 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.638206 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.638436 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:22.638462 (+ 26us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:22.638592 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 18:53:22.638680 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 18:53:22.638800 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
I20260811 18:53:22.639308 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 4244
I20260811 18:53:22.639416 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:22.639650 24459 external_mini_cluster.cc:1428] Setting key 376245c7e6907e23083ec290107c3409
I20260811 18:53:22.639639 4451 heartbeater.cc:347] Connected to a master server at 127.23.226.254:43063
I20260811 18:53:22.639721 4451 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:22.639907 4451 heartbeater.cc:511] Master 127.23.226.254:43063 requested a full tablet report, sending...
I20260811 18:53:22.640908 4133 ts_manager.cc:194] Registered new tserver with Master: fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193:34749)
I20260811 18:53:22.641670 4133 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:51291
I20260811 18:53:22.647198 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.640803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:38257 (local address 127.23.226.254:43063)
0811 18:53:22.640841 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:22.640843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:22.641092 (+ 249us) server_negotiation.cc:407] Connection header received
0811 18:53:22.641151 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:22.641151 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:22.641162 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:22.641221 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:22.641594 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.642197 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.643309 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.643485 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.643542 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.644575 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:22.644576 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:22.644577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:22.644584 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:22.646032 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.646488 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.646489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.646489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.646540 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.646763 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.646763 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.646764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.646858 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:22.646910 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:22.647085 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 18:53:22.647140 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:53:22.647347 4463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.640873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43063 (local address 127.23.226.193:38257)
0811 18:53:22.641023 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:22.641036 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:22.641104 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:22.641224 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:22.641224 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:22.641446 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:22.641514 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.641515 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.642300 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.642301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.643221 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.643224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.643561 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.643562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.643633 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.644031 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:22.644036 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:22.644470 (+ 434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:22.646123 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.646124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.646125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.646376 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.646608 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.646609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.646609 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.646687 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.646926 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:22.646927 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:22.646982 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 18:53:22.647069 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:53:22.647207 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for oryx/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab.
Entry for principal oryx/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab.
I20260811 18:53:22.670493 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43063
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab
--principal=oryx/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:22.757296 4469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:22.757524 4469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:22.757563 4469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:22.758755 4469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:22.758826 4469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:22.758862 4469 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:22.758893 4469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:22.760531 4469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab
--principal=oryx/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:43063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:22.760808 4469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:22.761029 4469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:22.766068 4475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:22.766026 4480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:22.766083 4482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:22.766228 4469 server_base.cc:1034] running on GCE node
I20260811 18:53:22.766530 4469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:22.766781 4469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:22.767982 4469 hybrid_clock.cc:648] HybridClock initialized: now 1786474402767955 us; error 43 us; skew 500 ppm
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:22.770553 4469 init.cc:377] Logged in from keytab as oryx/127.23.226.194@KRBTEST.COM (short username oryx)
I20260811 18:53:22.770983 4469 webserver.cc:460] Webserver started at http://127.23.226.194:43471/ using document root <none> and password file <none>
I20260811 18:53:22.771214 4469 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:22.771291 4469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:22.771435 4469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:22.772473 4469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "5420b72aba304bc38b382a78ecbebc06"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "3d36786e68feb00a64756c042bf180ca"
server_key_iv: "789a6db8903e8e7dc02f878ab637a0a9"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.772841 4469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "5420b72aba304bc38b382a78ecbebc06"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "3d36786e68feb00a64756c042bf180ca"
server_key_iv: "789a6db8903e8e7dc02f878ab637a0a9"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.774302 4469 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:22.775105 4492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.775295 4469 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:53:22.775403 4469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "5420b72aba304bc38b382a78ecbebc06"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "3d36786e68feb00a64756c042bf180ca"
server_key_iv: "789a6db8903e8e7dc02f878ab637a0a9"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.775490 4469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:22.799356 4469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:22.801542 4469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:22.801714 4469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:22.802333 4469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:22.802397 4469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.802464 4469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:22.802495 4469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.810014 4469 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:46117
I20260811 18:53:22.810117 4678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:46117 every 8 connection(s)
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:22.810477 4469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:22.814124 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.802968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:38587 (local address 127.23.226.254:43063)
0811 18:53:22.803047 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:22.803050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:22.803274 (+ 224us) server_negotiation.cc:407] Connection header received
0811 18:53:22.803825 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:22.803826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:22.803841 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:22.803926 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:22.804928 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.805776 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.807614 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.807948 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.808033 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.810808 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:22.810810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:22.810811 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:22.810821 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:22.812488 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.812982 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.812984 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.812985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.813055 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.813360 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.813361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.813362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.813500 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:22.813583 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:22.813919 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 18:53:22.814010 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 18:53:22.814330 4506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.802917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43063 (local address 127.23.226.194:38587)
0811 18:53:22.803123 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:22.803171 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:22.803718 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:22.804028 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:22.804032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:22.804465 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:22.804828 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.804835 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.805898 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.805899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.807496 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.807500 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.808048 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.808049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.808159 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.808779 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:22.808802 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:22.810696 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:22.812617 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.812625 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.812627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.812872 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.813153 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.813154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.813155 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.813279 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.813586 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:22.813595 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:22.813767 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 18:53:22.813894 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 18:53:22.814076 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":122,"threads_started":1}
I20260811 18:53:22.814935 4679 heartbeater.cc:347] Connected to a master server at 127.23.226.254:43063
I20260811 18:53:22.815054 4679 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:22.815249 4679 heartbeater.cc:511] Master 127.23.226.254:43063 requested a full tablet report, sending...
I20260811 18:53:22.815675 4134 ts_manager.cc:194] Registered new tserver with Master: 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117)
I20260811 18:53:22.816066 4134 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:38587
I20260811 18:53:22.816468 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 4469
I20260811 18:53:22.816584 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:22.816790 24459 external_mini_cluster.cc:1428] Setting key 171c524442d49a204e5f462e01dbaae0
I20260811 18:53:22.824236 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.816214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:57601 (local address 127.23.226.254:43063)
0811 18:53:22.816335 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:22.816337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:22.816491 (+ 154us) server_negotiation.cc:407] Connection header received
0811 18:53:22.816595 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:22.816596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:22.816619 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:22.816653 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:22.817204 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.817976 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.819765 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.820133 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.820219 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.821430 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:22.821431 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:22.821432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:22.821438 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:22.822937 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.823423 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.823424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.823424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.823476 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.823714 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.823715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.823715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.823883 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:22.823938 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:22.824110 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 18:53:22.824172 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 18:53:22.824250 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.816137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43063 (local address 127.23.226.194:57601)
0811 18:53:22.816426 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:22.816439 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:22.816518 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:22.816726 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:22.816727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:22.816960 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:22.817031 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.817033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.818189 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.818190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.819187 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.819190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.820295 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.820296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.820385 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.820852 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:22.820858 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:22.821322 (+ 464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:22.823036 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.823037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.823037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.823341 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.823554 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.823555 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.823555 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.823646 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.823960 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:22.823961 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:22.824021 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 18:53:22.824090 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 18:53:22.824181 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for oryx/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab.
Entry for principal oryx/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab.
I20260811 18:53:22.850165 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:43063
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab
--principal=oryx/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:44361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:22.935715 4689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:22.935956 4689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:22.935995 4689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:22.937119 4689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:22.937192 4689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:22.937227 4689 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 18:53:22.937268 4689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:22.938855 4689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:44361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab
--principal=oryx/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.23.226.254:43063
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:22.939136 4689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:22.939366 4689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:22.944567 4695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:22.944582 4694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:22.944661 4700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:22.944924 4689 server_base.cc:1034] running on GCE node
I20260811 18:53:22.945209 4689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:22.945473 4689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:22.946669 4689 hybrid_clock.cc:648] HybridClock initialized: now 1786474402946652 us; error 32 us; skew 500 ppm
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:22.949456 4689 init.cc:377] Logged in from keytab as oryx/127.23.226.195@KRBTEST.COM (short username oryx)
I20260811 18:53:22.949967 4689 webserver.cc:460] Webserver started at http://127.23.226.195:36303/ using document root <none> and password file <none>
I20260811 18:53:22.950191 4689 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:22.950237 4689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:22.950335 4689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:22.951479 4689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "75a0e1ebed1d483d84e084bfd7f689f9"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "df2f0d05032908a71b67bac031c1f5fd"
server_key_iv: "e792712885561bfb0ed0decc6da5be1a"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.951817 4689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "75a0e1ebed1d483d84e084bfd7f689f9"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "df2f0d05032908a71b67bac031c1f5fd"
server_key_iv: "e792712885561bfb0ed0decc6da5be1a"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.953258 4689 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:22.954051 4710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.954285 4689 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:22.954373 4689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "75a0e1ebed1d483d84e084bfd7f689f9"
format_stamp: "Formatted at 2026-08-11 18:53:22 on dist-test-slave-68xk"
server_key: "df2f0d05032908a71b67bac031c1f5fd"
server_key_iv: "e792712885561bfb0ed0decc6da5be1a"
server_key_version: "encryptionkey@0"
I20260811 18:53:22.954487 4689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:22.966888 4689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:22.968909 4689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:22.969022 4689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:22.969491 4689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:22.969532 4689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.969554 4689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:22.969596 4689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:22.976980 4689 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:41281
I20260811 18:53:22.977089 4885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:41281 every 8 connection(s)
I20260811 18:53:22.977419 4689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:22.981097 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.970037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:47063 (local address 127.23.226.254:43063)
0811 18:53:22.970083 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:22.970085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:22.970344 (+ 259us) server_negotiation.cc:407] Connection header received
0811 18:53:22.971201 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:22.971203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:22.971220 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:22.971303 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:22.972202 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.973039 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.974744 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.975058 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.975153 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.978211 (+ 3058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:22.978212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:22.978212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:22.978221 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:22.979737 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.980160 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.980161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.980162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.980213 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.980447 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.980448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.980448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.980554 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:22.980613 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:22.980954 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 18:53:22.981030 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:53:22.981272 4722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.970038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43063 (local address 127.23.226.195:47063)
0811 18:53:22.970217 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:22.970255 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:22.970884 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:22.971368 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:22.971372 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:22.971768 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:22.972078 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.972085 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.973166 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.973167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.974620 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.974624 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.975197 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.975198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.975336 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.976070 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:22.976081 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:22.978006 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:22.979810 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.979817 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.979819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.980051 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.980278 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.980279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.980279 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.980388 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.980651 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:22.980659 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:22.980787 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 18:53:22.980895 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:53:22.981027 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":86,"threads_started":1}
I20260811 18:53:22.981859 4886 heartbeater.cc:347] Connected to a master server at 127.23.226.254:43063
I20260811 18:53:22.981953 4886 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:22.982168 4886 heartbeater.cc:511] Master 127.23.226.254:43063 requested a full tablet report, sending...
I20260811 18:53:22.982630 4134 ts_manager.cc:194] Registered new tserver with Master: 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:22.983021 4134 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:47063
I20260811 18:53:22.986234 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 4689
I20260811 18:53:22.986344 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:22.986613 24459 external_mini_cluster.cc:1428] Setting key f505272f2903228d314d90ea1bebdfd7
I20260811 18:53:22.987668 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:53:22.989420 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.983175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:35309 (local address 127.23.226.254:43063)
0811 18:53:22.983221 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:22.983224 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:22.983333 (+ 109us) server_negotiation.cc:407] Connection header received
0811 18:53:22.983399 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:22.983400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:22.983411 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:22.983467 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:22.983825 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.984344 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.985151 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.985385 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.985474 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.986504 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:22.986505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:22.986505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:22.986511 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:22.988218 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.988670 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.988671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.988671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.988723 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:22.988942 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:22.988943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:22.988943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:22.989038 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:22.989119 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:22.989307 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 18:53:22.989362 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:22.989593 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:22.983111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43063 (local address 127.23.226.195:35309)
0811 18:53:22.983252 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:22.983263 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:22.983333 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:22.983470 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:22.983471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:22.983681 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:22.983738 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.983739 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.984447 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.984448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.985033 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:22.985035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:22.985473 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:22.985474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:22.985548 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:22.985939 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:22.985943 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:22.986380 (+ 437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:22.988306 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.988308 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.988308 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.988589 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.988797 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:22.988798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:22.988798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:22.988878 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:22.989144 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:22.989145 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:22.989201 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 18:53:22.989288 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:53:22.989416 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
Aug 11 18:53:22 dist-test-slave-68xk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 18:53:23 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:23 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:53:23.013664 4212 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:23.006266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59794 (local address 127.23.226.254:43063)
0811 18:53:23.006336 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.006339 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.006350 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:23.006442 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.006443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.006456 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.006512 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:23.007344 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.008182 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.009374 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.009691 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.009735 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.013562 (+ 3827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59794: BlockingRecv error: recv got EOF from 127.0.0.1:59794 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 18:53:23 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:23.024828 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.017421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59802 (local address 127.23.226.254:43063)
0811 18:53:23.017474 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.017476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.017491 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:53:23.017562 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.017563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.017572 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.017643 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:23.018388 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.019093 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.019757 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.019944 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.019997 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.022221 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:23.022222 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:23.022222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:23.022229 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:23.023711 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:23.024124 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:23.024125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:23.024125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:23.024185 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:23.024382 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:23.024382 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:23.024383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:23.024488 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:23.024568 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.024665 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.024730 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:53:23.026751 4134 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:23.028375 4134 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:23.035681 4919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.031669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:41281 (local address 127.0.0.1:35556)
0811 18:53:23.032196 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.032208 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.032266 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.032612 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.032613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.032614 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:23.032679 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.032680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.033568 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.033570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.034593 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.034596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.035317 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.035318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.035404 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.035419 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.035525 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.035593 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":23,"thread_start_us":100,"threads_started":1}
I20260811 18:53:23.035696 4921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.031758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35556 (local address 127.23.226.195:41281)
0811 18:53:23.031947 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.031953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.032397 (+ 444us) server_negotiation.cc:407] Connection header received
0811 18:53:23.032447 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.032450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.032467 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.032545 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:23.032754 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.033466 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.034694 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.035219 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.035335 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.035400 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.035545 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.035586 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":112,"threads_started":1}
I20260811 18:53:23.036783 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.031663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:46117 (local address 127.0.0.1:34516)
0811 18:53:23.032139 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.032184 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.032266 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.032571 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.032575 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.032577 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:23.032676 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.032679 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.034408 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.034432 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.035580 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.035583 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.036503 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.036504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.036591 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.036595 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.036677 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.036722 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":57,"threads_started":1}
I20260811 18:53:23.036664 4788 tablet_service.cc:1467] Processing CreateTablet for tablet cd582c2ab7df46419ea086bf78b7e267 (DEFAULT_TABLE table=test-table [id=ac3226c97a274ce38f881e2cdba8e9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.037060 4925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.031942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34516 (local address 127.23.226.194:46117)
0811 18:53:23.032127 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.032131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.032280 (+ 149us) server_negotiation.cc:407] Connection header received
0811 18:53:23.032363 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.032365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.032386 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.032475 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:23.033559 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.034304 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.035688 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.036411 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.036508 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.036570 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.036894 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.036945 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
I20260811 18:53:23.037081 4788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd582c2ab7df46419ea086bf78b7e267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.037909 4916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.031678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34749 (local address 127.0.0.1:34708)
0811 18:53:23.032368 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.032377 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.032420 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.032631 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.032632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.032634 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:23.032683 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.032685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.035669 (+ 2984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.035670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.036755 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.036758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.037668 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.037669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.037728 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.037732 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.037795 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.037834 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":97,"threads_started":1}
I20260811 18:53:23.037798 4574 tablet_service.cc:1467] Processing CreateTablet for tablet cd582c2ab7df46419ea086bf78b7e267 (DEFAULT_TABLE table=test-table [id=ac3226c97a274ce38f881e2cdba8e9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.037950 4922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.031947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34708 (local address 127.23.226.193:34749)
0811 18:53:23.032213 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.032216 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.032479 (+ 263us) server_negotiation.cc:407] Connection header received
0811 18:53:23.032529 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.032531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.032548 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.032634 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:23.034460 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.035561 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.036923 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.037578 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.037687 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.037741 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.037809 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.037845 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":93,"threads_started":1}
I20260811 18:53:23.038154 4574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd582c2ab7df46419ea086bf78b7e267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.038755 4345 tablet_service.cc:1467] Processing CreateTablet for tablet cd582c2ab7df46419ea086bf78b7e267 (DEFAULT_TABLE table=test-table [id=ac3226c97a274ce38f881e2cdba8e9ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.039170 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd582c2ab7df46419ea086bf78b7e267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.041301 4928 tablet_bootstrap.cc:492] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: Bootstrap starting.
I20260811 18:53:23.042104 4928 tablet_bootstrap.cc:654] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.042176 4929 tablet_bootstrap.cc:492] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Bootstrap starting.
I20260811 18:53:23.042652 4928 log.cc:824] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:23.042893 4929 tablet_bootstrap.cc:654] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.043166 4932 tablet_bootstrap.cc:492] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: Bootstrap starting.
I20260811 18:53:23.043267 4929 log.cc:824] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:23.043792 4932 tablet_bootstrap.cc:654] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.044075 4932 log.cc:824] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:23.044138 4929 tablet_bootstrap.cc:492] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: No bootstrap required, opened a new log
I20260811 18:53:23.044229 4929 ts_tablet_manager.cc:1397] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:23.044852 4932 tablet_bootstrap.cc:492] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: No bootstrap required, opened a new log
I20260811 18:53:23.044852 4928 tablet_bootstrap.cc:492] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: No bootstrap required, opened a new log
I20260811 18:53:23.044929 4932 ts_tablet_manager.cc:1397] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:23.044929 4928 ts_tablet_manager.cc:1397] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 18:53:23.046031 4929 raft_consensus.cc:348] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.046198 4929 raft_consensus.cc:374] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.046243 4929 raft_consensus.cc:729] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5420b72aba304bc38b382a78ecbebc06, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.046373 4929 consensus_queue.cc:260] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.046695 4929 ts_tablet_manager.cc:1428] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:53:23.047003 4928 raft_consensus.cc:348] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.047005 4932 raft_consensus.cc:348] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.047168 4932 raft_consensus.cc:374] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.047168 4928 raft_consensus.cc:374] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.047209 4928 raft_consensus.cc:729] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a0e1ebed1d483d84e084bfd7f689f9, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.047209 4932 raft_consensus.cc:729] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.047322 4928 consensus_queue.cc:260] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.047339 4932 consensus_queue.cc:260] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.047587 4928 ts_tablet_manager.cc:1428] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 18:53:23.047582 4932 ts_tablet_manager.cc:1428] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 18:53:23.047739 4886 heartbeater.cc:503] Master 127.23.226.254:43063 was elected leader, sending a full tablet report...
I20260811 18:53:23.047771 4679 heartbeater.cc:503] Master 127.23.226.254:43063 was elected leader, sending a full tablet report...
I20260811 18:53:23.048022 4451 heartbeater.cc:503] Master 127.23.226.254:43063 was elected leader, sending a full tablet report...
W20260811 18:53:23.061203 4680 tablet.cc:2369] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:23.086634 4944 raft_consensus.cc:482] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:23.086762 4944 raft_consensus.cc:504] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.087108 4944 leader_election.cc:288] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117), 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:23.090744 4921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.087401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:36527 (local address 127.23.226.195:41281)
0811 18:53:23.087457 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.087459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.087470 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:23.087532 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.087533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.087543 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.087608 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:23.087844 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.088457 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.089895 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.090301 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.090366 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.090374 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.090614 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.090669 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:53:23.090740 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.087323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:41281 (local address 127.23.226.193:36527)
0811 18:53:23.087384 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.087398 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.087453 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.087635 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.087636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.087639 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:23.087750 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.087752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.088543 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.088544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.089804 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.089807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.090393 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.090394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.090530 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.090534 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.090581 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.090615 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":31}
I20260811 18:53:23.090806 4925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.087473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:47823 (local address 127.23.226.194:46117)
0811 18:53:23.087524 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.087526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.087681 (+ 155us) server_negotiation.cc:407] Connection header received
0811 18:53:23.087741 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.087742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.087753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.087828 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:23.088019 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.088486 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.089928 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.090300 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.090400 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.090408 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.090690 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.090731 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:53:23.090966 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.087325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:46117 (local address 127.23.226.193:47823)
0811 18:53:23.087602 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.087613 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.087670 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.087844 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.087845 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.087860 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:23.087945 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.087946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.088622 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.088623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.089804 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.089807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.090477 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.090478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.090586 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.090591 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.090665 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.090708 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":94,"thread_start_us":128,"threads_started":1}
I20260811 18:53:23.091329 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd582c2ab7df46419ea086bf78b7e267" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06" is_pre_election: true
I20260811 18:53:23.091357 4824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd582c2ab7df46419ea086bf78b7e267" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" is_pre_election: true
I20260811 18:53:23.091511 4602 raft_consensus.cc:2454] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 0.
I20260811 18:53:23.091516 4824 raft_consensus.cc:2454] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 0.
I20260811 18:53:23.091774 4273 leader_election.cc:302] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, fa6c5d7a19ad44a8a50dd01f768149d9; no voters:
I20260811 18:53:23.091941 4944 raft_consensus.cc:2781] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:23.092003 4944 raft_consensus.cc:482] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:23.092028 4944 raft_consensus.cc:3037] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.093111 4944 raft_consensus.cc:504] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.093281 4944 leader_election.cc:288] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117), 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:23.093474 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd582c2ab7df46419ea086bf78b7e267" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06"
I20260811 18:53:23.093535 4824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd582c2ab7df46419ea086bf78b7e267" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a0e1ebed1d483d84e084bfd7f689f9"
I20260811 18:53:23.093564 4602 raft_consensus.cc:3037] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.093638 4824 raft_consensus.cc:3037] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.094367 4602 raft_consensus.cc:2454] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 1.
I20260811 18:53:23.094471 4824 raft_consensus.cc:2454] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 1.
I20260811 18:53:23.094595 4273 leader_election.cc:302] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, fa6c5d7a19ad44a8a50dd01f768149d9; no voters:
I20260811 18:53:23.094720 4944 raft_consensus.cc:2781] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:23.094862 4944 raft_consensus.cc:686] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 LEADER]: Becoming Leader. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Running, Role: LEADER
I20260811 18:53:23.094965 4944 consensus_queue.cc:237] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } }
I20260811 18:53:23.095863 4133 catalog_manager.cc:5495] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } health_report { overall_health: HEALTHY } } }
I20260811 18:53:23.108135 4922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.105683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34720 (local address 127.23.226.193:34749)
0811 18:53:23.105761 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.105763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.105771 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:53:23.105811 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.105812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.105828 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.105889 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:23.106046 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.106577 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.107361 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.107558 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.107635 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.107812 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:23.107913 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:23.108007 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.108032 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.108052 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:53:23.109983 4602 raft_consensus.cc:1261] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Refusing update from remote peer fa6c5d7a19ad44a8a50dd01f768149d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:23.110015 4824 raft_consensus.cc:1261] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Refusing update from remote peer fa6c5d7a19ad44a8a50dd01f768149d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:23.110316 4944 consensus_queue.cc:1035] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:23.110508 4946 consensus_queue.cc:1035] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:23.113561 4950 mvcc.cc:205] Tried to move back new op lower bound from 7317399155135512576 to 7317399155077566464. Current Snapshot: MvccSnapshot[applied={T|T < 7317399155135512576 or (T in {7317399155135512576})}]
I20260811 18:53:23.113703 4951 mvcc.cc:205] Tried to move back new op lower bound from 7317399155135512576 to 7317399155077566464. Current Snapshot: MvccSnapshot[applied={T|T < 7317399155135512576}]
I20260811 18:53:23.115072 4133 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:23.115175 4133 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:23.115936 4133 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: Sending DeleteTablet for 3 replicas of tablet cd582c2ab7df46419ea086bf78b7e267
I20260811 18:53:23.116350 4345 tablet_service.cc:1514] Processing DeleteTablet for tablet cd582c2ab7df46419ea086bf78b7e267 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:23 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34708
I20260811 18:53:23.116374 4574 tablet_service.cc:1514] Processing DeleteTablet for tablet cd582c2ab7df46419ea086bf78b7e267 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:23 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34516
I20260811 18:53:23.116466 4133 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:23.116617 4133 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:23.116606 4788 tablet_service.cc:1514] Processing DeleteTablet for tablet cd582c2ab7df46419ea086bf78b7e267 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:23 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:35556
I20260811 18:53:23.117030 4963 tablet_replica.cc:330] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: stopping tablet replica
I20260811 18:53:23.117134 4963 raft_consensus.cc:2229] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:23.117242 4963 raft_consensus.cc:2258] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:23.117740 4963 ts_tablet_manager.cc:1905] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:23.117863 4960 tablet_replica.cc:330] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: stopping tablet replica
I20260811 18:53:23.117955 4960 raft_consensus.cc:2229] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:23.118070 4960 raft_consensus.cc:2258] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:23.118134 4574 tablet_service.cc:1467] Processing CreateTablet for tablet d58e6d7e023345cba624523eb57e08d9 (DEFAULT_TABLE table=test-table [id=4783c88324db4d7893b2c6b2bbb49ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.118132 4788 tablet_service.cc:1467] Processing CreateTablet for tablet d58e6d7e023345cba624523eb57e08d9 (DEFAULT_TABLE table=test-table [id=4783c88324db4d7893b2c6b2bbb49ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.118247 4788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d58e6d7e023345cba624523eb57e08d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.118252 4574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d58e6d7e023345cba624523eb57e08d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.118280 4961 tablet_replica.cc:330] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: stopping tablet replica
I20260811 18:53:23.118373 4961 raft_consensus.cc:2229] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:23.118824 4960 ts_tablet_manager.cc:1905] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:23.118885 4345 tablet_service.cc:1467] Processing CreateTablet for tablet d58e6d7e023345cba624523eb57e08d9 (DEFAULT_TABLE table=test-table [id=4783c88324db4d7893b2c6b2bbb49ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.119001 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d58e6d7e023345cba624523eb57e08d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.119573 4928 tablet_bootstrap.cc:492] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: Bootstrap starting.
I20260811 18:53:23.120014 4928 tablet_bootstrap.cc:654] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.119506 4961 raft_consensus.cc:2258] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:23.120359 4932 tablet_bootstrap.cc:492] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: Bootstrap starting.
I20260811 18:53:23.120767 4961 ts_tablet_manager.cc:1905] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:23.120802 4932 tablet_bootstrap.cc:654] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.121109 4963 ts_tablet_manager.cc:1918] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:23.121181 4963 log.cc:1196] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/cd582c2ab7df46419ea086bf78b7e267
I20260811 18:53:23.121445 4963 ts_tablet_manager.cc:1939] T cd582c2ab7df46419ea086bf78b7e267 P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting consensus metadata
I20260811 18:53:23.121843 4929 tablet_bootstrap.cc:492] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: Bootstrap starting.
I20260811 18:53:23.121837 4111 catalog_manager.cc:4841] TS 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281): tablet cd582c2ab7df46419ea086bf78b7e267 (table test-table [id=ac3226c97a274ce38f881e2cdba8e9ec]) successfully deleted
I20260811 18:53:23.122686 4960 ts_tablet_manager.cc:1918] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:23.122771 4960 log.cc:1196] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/cd582c2ab7df46419ea086bf78b7e267
I20260811 18:53:23.122816 4929 tablet_bootstrap.cc:654] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.123040 4960 ts_tablet_manager.cc:1939] T cd582c2ab7df46419ea086bf78b7e267 P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting consensus metadata
I20260811 18:53:23.123481 4110 catalog_manager.cc:4841] TS fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193:34749): tablet cd582c2ab7df46419ea086bf78b7e267 (table test-table [id=ac3226c97a274ce38f881e2cdba8e9ec]) successfully deleted
I20260811 18:53:23.123538 4929 tablet_bootstrap.cc:492] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: No bootstrap required, opened a new log
I20260811 18:53:23.123585 4929 ts_tablet_manager.cc:1397] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:23.123747 4929 raft_consensus.cc:348] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.123832 4929 raft_consensus.cc:374] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.123855 4929 raft_consensus.cc:729] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5420b72aba304bc38b382a78ecbebc06, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.123898 4929 consensus_queue.cc:260] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.124019 4929 ts_tablet_manager.cc:1428] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:23.124055 4961 ts_tablet_manager.cc:1918] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:23.124128 4961 log.cc:1196] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/cd582c2ab7df46419ea086bf78b7e267
I20260811 18:53:23.124398 4961 ts_tablet_manager.cc:1939] T cd582c2ab7df46419ea086bf78b7e267 P 5420b72aba304bc38b382a78ecbebc06: Deleting consensus metadata
I20260811 18:53:23.124800 4112 catalog_manager.cc:4841] TS 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117): tablet cd582c2ab7df46419ea086bf78b7e267 (table test-table [id=ac3226c97a274ce38f881e2cdba8e9ec]) successfully deleted
I20260811 18:53:23.125077 4928 tablet_bootstrap.cc:492] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: No bootstrap required, opened a new log
I20260811 18:53:23.125126 4928 ts_tablet_manager.cc:1397] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20260811 18:53:23.125248 4932 tablet_bootstrap.cc:492] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: No bootstrap required, opened a new log
I20260811 18:53:23.125288 4932 ts_tablet_manager.cc:1397] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 18:53:23.125286 4928 raft_consensus.cc:348] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.125358 4928 raft_consensus.cc:374] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.125384 4928 raft_consensus.cc:729] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a0e1ebed1d483d84e084bfd7f689f9, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.125432 4928 consensus_queue.cc:260] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.125433 4932 raft_consensus.cc:348] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.125494 4932 raft_consensus.cc:374] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.125514 4932 raft_consensus.cc:729] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.125524 4928 ts_tablet_manager.cc:1428] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:23.125554 4932 consensus_queue.cc:260] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.125655 4932 ts_tablet_manager.cc:1428] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260811 18:53:23.137632 4455 tablet.cc:2369] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:53:23.228127 4887 tablet.cc:2369] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:23.256059 4941 raft_consensus.cc:482] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:23.256175 4941 raft_consensus.cc:504] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.256486 4941 leader_election.cc:288] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193:34749), 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117)
I20260811 18:53:23.260622 4925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.256839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:41295 (local address 127.23.226.194:46117)
0811 18:53:23.256889 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.256892 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.256903 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:23.256942 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.256943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.256953 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.257041 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:23.257300 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.258085 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.259632 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.260201 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.260284 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.260294 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.260506 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.260549 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:53:23.260622 4922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.256848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:50849 (local address 127.23.226.193:34749)
0811 18:53:23.256898 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.256900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.256969 (+ 69us) server_negotiation.cc:407] Connection header received
0811 18:53:23.257026 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.257027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.257039 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.257098 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:23.257299 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.258064 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.259632 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.260209 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.260284 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.260294 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.260506 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.260551 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:53:23.260684 4722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.256745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:46117 (local address 127.23.226.195:41295)
0811 18:53:23.256809 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.256821 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.256873 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.257094 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.257095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.257097 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:23.257184 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.257186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.258164 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.258164 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.259529 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.259532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.260309 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.260311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.260415 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.260419 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.260482 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.260532 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":36}
I20260811 18:53:23.260697 4973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.256746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34749 (local address 127.23.226.195:50849)
0811 18:53:23.256903 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.256912 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.256970 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.257126 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.257126 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.257128 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:23.257215 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.257216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.258145 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.258147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.259529 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.259532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.260330 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.260331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.260403 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.260408 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.260482 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.260531 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":72,"thread_start_us":83,"threads_started":1}
I20260811 18:53:23.261001 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58e6d7e023345cba624523eb57e08d9" candidate_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06" is_pre_election: true
I20260811 18:53:23.261059 4383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58e6d7e023345cba624523eb57e08d9" candidate_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" is_pre_election: true
I20260811 18:53:23.261184 4602 raft_consensus.cc:2454] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75a0e1ebed1d483d84e084bfd7f689f9 in term 0.
I20260811 18:53:23.261222 4383 raft_consensus.cc:2454] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75a0e1ebed1d483d84e084bfd7f689f9 in term 0.
I20260811 18:53:23.261411 4715 leader_election.cc:302] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, 75a0e1ebed1d483d84e084bfd7f689f9; no voters:
I20260811 18:53:23.261569 4941 raft_consensus.cc:2781] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:23.261617 4941 raft_consensus.cc:482] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:23.261637 4941 raft_consensus.cc:3037] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.262344 4941 raft_consensus.cc:504] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.262529 4941 leader_election.cc:288] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [CANDIDATE]: Term 1 election: Requested vote from peers fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193:34749), 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117)
I20260811 18:53:23.262732 4383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58e6d7e023345cba624523eb57e08d9" candidate_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9"
I20260811 18:53:23.262795 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58e6d7e023345cba624523eb57e08d9" candidate_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06"
I20260811 18:53:23.262853 4383 raft_consensus.cc:3037] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.262872 4602 raft_consensus.cc:3037] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.263540 4602 raft_consensus.cc:2454] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75a0e1ebed1d483d84e084bfd7f689f9 in term 1.
I20260811 18:53:23.263712 4715 leader_election.cc:302] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, 75a0e1ebed1d483d84e084bfd7f689f9; no voters:
I20260811 18:53:23.263741 4383 raft_consensus.cc:2454] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75a0e1ebed1d483d84e084bfd7f689f9 in term 1.
I20260811 18:53:23.263821 4941 raft_consensus.cc:2781] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:23.263978 4941 raft_consensus.cc:686] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 LEADER]: Becoming Leader. State: Replica: 75a0e1ebed1d483d84e084bfd7f689f9, State: Running, Role: LEADER
I20260811 18:53:23.264060 4941 consensus_queue.cc:237] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.264887 4134 catalog_manager.cc:5495] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195). New cstate: current_term: 1 leader_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } health_report { overall_health: HEALTHY } } }
Aug 11 18:53:23 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474402, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.254@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:23.323192 4983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.315366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:43063 (local address 127.0.0.1:59816)
0811 18:53:23.315591 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.315603 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.315673 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.315869 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.315870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.316259 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:23.316309 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.316312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.317031 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.317032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.317644 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.317647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.317996 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.317996 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.318043 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.318679 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:23.318685 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:23.320228 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:23.321882 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:23.321890 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:23.321892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:23.322174 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:23.322428 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:23.322428 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:23.322429 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:23.322492 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:23.322806 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:23.322814 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:23.322862 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.322932 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.323105 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":98,"threads_started":1}
I20260811 18:53:23.323273 4212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.315431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59816 (local address 127.23.226.254:43063)
0811 18:53:23.315516 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.315535 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.315730 (+ 195us) server_negotiation.cc:407] Connection header received
0811 18:53:23.315760 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.315761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.315773 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.315818 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:23.316400 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.316959 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.317736 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.317920 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.317993 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.320323 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:23.320324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:23.320324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:23.320331 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:23.321793 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:23.322269 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:23.322271 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:23.322271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:23.322333 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:23.322589 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:23.322591 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:23.322591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:23.322718 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:23.322779 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.322966 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.323191 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":147,"server-negotiator.queue_time_us":56}
I20260811 18:53:23.325448 4134 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:59816:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 18:53:23.325677 4134 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:23.327248 4345 tablet_service.cc:1467] Processing CreateTablet for tablet 75994e7c4caf4c97a6a8a5e79c806998 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d9732896b6924fd2804e08771116ef11]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:23.327277 4574 tablet_service.cc:1467] Processing CreateTablet for tablet 75994e7c4caf4c97a6a8a5e79c806998 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d9732896b6924fd2804e08771116ef11]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:23.327294 4788 tablet_service.cc:1467] Processing CreateTablet for tablet 75994e7c4caf4c97a6a8a5e79c806998 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d9732896b6924fd2804e08771116ef11]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 18:53:23.327418 4574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75994e7c4caf4c97a6a8a5e79c806998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.327421 4788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75994e7c4caf4c97a6a8a5e79c806998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.327422 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75994e7c4caf4c97a6a8a5e79c806998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.328681 4929 tablet_bootstrap.cc:492] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: Bootstrap starting.
I20260811 18:53:23.328938 4928 tablet_bootstrap.cc:492] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: Bootstrap starting.
I20260811 18:53:23.328964 4932 tablet_bootstrap.cc:492] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: Bootstrap starting.
I20260811 18:53:23.329165 4929 tablet_bootstrap.cc:654] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.329279 4928 tablet_bootstrap.cc:654] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.329315 4932 tablet_bootstrap.cc:654] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.329905 4929 tablet_bootstrap.cc:492] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: No bootstrap required, opened a new log
I20260811 18:53:23.329986 4929 ts_tablet_manager.cc:1397] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:23.330014 4928 tablet_bootstrap.cc:492] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: No bootstrap required, opened a new log
I20260811 18:53:23.330072 4928 ts_tablet_manager.cc:1397] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:23.330164 4929 raft_consensus.cc:348] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.330288 4929 raft_consensus.cc:374] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.330322 4929 raft_consensus.cc:729] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5420b72aba304bc38b382a78ecbebc06, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.330365 4929 consensus_queue.cc:260] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.330394 4928 raft_consensus.cc:348] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.330497 4928 raft_consensus.cc:374] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.330490 4929 ts_tablet_manager.cc:1428] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 18:53:23.330528 4928 raft_consensus.cc:729] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a0e1ebed1d483d84e084bfd7f689f9, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.330585 4928 consensus_queue.cc:260] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.330560 4938 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.330651 4938 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:23.330689 4928 ts_tablet_manager.cc:1428] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:23.330811 4941 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.330879 4941 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:23.331462 4932 tablet_bootstrap.cc:492] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: No bootstrap required, opened a new log
I20260811 18:53:23.331525 4932 ts_tablet_manager.cc:1397] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 18:53:23.331656 4932 raft_consensus.cc:348] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.331725 4932 raft_consensus.cc:374] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.331740 4932 raft_consensus.cc:729] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.331800 4932 consensus_queue.cc:260] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.331895 4932 ts_tablet_manager.cc:1428] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 18:53:23.331986 4946 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.332049 4946 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:23.696915 4946 raft_consensus.cc:482] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:23.697050 4946 raft_consensus.cc:504] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.697367 4946 leader_election.cc:288] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117), 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:23.697569 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75994e7c4caf4c97a6a8a5e79c806998" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06" is_pre_election: true
I20260811 18:53:23.697710 4602 raft_consensus.cc:2454] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 0.
I20260811 18:53:23.697635 4824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75994e7c4caf4c97a6a8a5e79c806998" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" is_pre_election: true
I20260811 18:53:23.697772 4824 raft_consensus.cc:2454] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 0.
I20260811 18:53:23.697907 4273 leader_election.cc:302] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, fa6c5d7a19ad44a8a50dd01f768149d9; no voters:
I20260811 18:53:23.698050 4946 raft_consensus.cc:2781] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:23.698108 4946 raft_consensus.cc:482] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:23.698128 4946 raft_consensus.cc:3037] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.698990 4946 raft_consensus.cc:504] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.699157 4946 leader_election.cc:288] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117), 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:23.699329 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75994e7c4caf4c97a6a8a5e79c806998" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06"
I20260811 18:53:23.699414 4602 raft_consensus.cc:3037] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.699354 4824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75994e7c4caf4c97a6a8a5e79c806998" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a0e1ebed1d483d84e084bfd7f689f9"
I20260811 18:53:23.699455 4824 raft_consensus.cc:3037] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:23.700035 4602 raft_consensus.cc:2454] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 1.
I20260811 18:53:23.700242 4824 raft_consensus.cc:2454] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 1.
I20260811 18:53:23.700228 4273 leader_election.cc:302] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, fa6c5d7a19ad44a8a50dd01f768149d9; no voters:
I20260811 18:53:23.700379 4946 raft_consensus.cc:2781] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:23.700495 4946 raft_consensus.cc:686] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 LEADER]: Becoming Leader. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Running, Role: LEADER
I20260811 18:53:23.700552 4946 consensus_queue.cc:237] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.700863 4990 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: TxnStatusTablet state changed. Reason: New leader fa6c5d7a19ad44a8a50dd01f768149d9. Latest consensus state: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.700977 4990 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:23.701150 4992 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 18:53:23.701287 4992 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 18:53:23.701287 4134 catalog_manager.cc:5495] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:23.722592 4941 consensus_queue.cc:1035] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:23.724573 4974 consensus_queue.cc:1035] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:23.774183 5005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.770875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34732 (local address 127.23.226.193:34749)
0811 18:53:23.770981 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.770983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.770993 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:23.771026 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.771027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.771043 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.771104 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:23.771270 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.772003 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.773273 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.773589 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.773663 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.773886 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:23.773922 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:23.773977 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.774061 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.774090 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":60,"threads_started":1}
I20260811 18:53:23.774224 4983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.770815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34749 (local address 127.0.0.1:34732)
0811 18:53:23.770905 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.770917 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.770962 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.771129 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.771130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.771131 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:23.771185 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.771187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.772132 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.772133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.773165 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.773169 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.773677 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.773678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.773766 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.773787 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:23.773992 (+ 205us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:23.773998 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.774056 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.774115 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:53:23.775776 4824 raft_consensus.cc:1261] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Refusing update from remote peer fa6c5d7a19ad44a8a50dd01f768149d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:23.776116 4946 consensus_queue.cc:1035] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:23.776825 4974 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: TxnStatusTablet state changed. Reason: New leader fa6c5d7a19ad44a8a50dd01f768149d9. Latest consensus state: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.776932 4974 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:23.777230 4602 raft_consensus.cc:1261] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Refusing update from remote peer fa6c5d7a19ad44a8a50dd01f768149d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:23.777515 4946 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.777596 4946 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:23.778553 4974 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.778644 4974 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P 75a0e1ebed1d483d84e084bfd7f689f9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:23.779062 4946 consensus_queue.cc:1035] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:23.779942 5016 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.780052 5016 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:23.780134 4938 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: TxnStatusTablet state changed. Reason: New leader fa6c5d7a19ad44a8a50dd01f768149d9. Latest consensus state: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.780227 4938 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P 5420b72aba304bc38b382a78ecbebc06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 18:53:23.783825 5018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.779968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35560 (local address 127.23.226.195:41281)
0811 18:53:23.780644 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.780646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.780653 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:53:23.780699 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.780700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.780723 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.780803 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:23.780976 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.781730 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.782849 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.783213 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.783296 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.783469 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:23.783598 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:23.783665 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.783753 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.783771 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":43,"threads_started":1}
I20260811 18:53:23.788757 5005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.786306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:56501 (local address 127.23.226.193:34749)
0811 18:53:23.786352 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.786354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.786461 (+ 107us) server_negotiation.cc:407] Connection header received
0811 18:53:23.786554 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.786555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.786566 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.786614 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:23.786794 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.787263 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.788015 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.788271 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.788351 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.788515 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:23.788548 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:23.788599 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.788663 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.788686 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:53:23.788785 5023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.786201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34749 (local address 127.23.226.195:56501)
0811 18:53:23.786360 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.786371 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.786468 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.786663 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.786664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.786665 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:23.786713 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.786714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.787351 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.787352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.787923 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.787925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.788351 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.788352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.788415 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.788430 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:23.788611 (+ 181us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:23.788613 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.788662 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.788708 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":100,"threads_started":1}
I20260811 18:53:23.789533 4946 tablet_replica.cc:439] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } } }
I20260811 18:53:23.789661 4946 tablet_replica.cc:442] T 75994e7c4caf4c97a6a8a5e79c806998 P fa6c5d7a19ad44a8a50dd01f768149d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 18:53:23.798900 5018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.796346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:39051 (local address 127.23.226.195:41281)
0811 18:53:23.796383 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.796384 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.796453 (+ 69us) server_negotiation.cc:407] Connection header received
0811 18:53:23.796531 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.796531 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.796539 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.796582 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:23.796699 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.797137 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.798219 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.798399 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.798519 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.798704 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:23.798732 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:23.798770 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.798828 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.798846 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:53:23.799125 5026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.796175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:41281 (local address 127.23.226.193:39051)
0811 18:53:23.796392 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:23.796405 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:23.796470 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:23.796589 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:23.796590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:23.796591 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:23.796638 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.796640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.797225 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.797226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.798142 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:23.798145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.798514 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.798515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:23.798597 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.798615 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:23.798775 (+ 160us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:23.798776 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 18:53:23.798827 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 18:53:23.798878 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":83,"threads_started":1}
I20260811 18:53:23.807776 4134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:23.807896 4134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:23.808530 4134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: Sending DeleteTablet for 3 replicas of tablet d58e6d7e023345cba624523eb57e08d9
I20260811 18:53:23.808830 4574 tablet_service.cc:1514] Processing DeleteTablet for tablet d58e6d7e023345cba624523eb57e08d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:23 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34516
I20260811 18:53:23.808830 4788 tablet_service.cc:1514] Processing DeleteTablet for tablet d58e6d7e023345cba624523eb57e08d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:23 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:35556
I20260811 18:53:23.809077 4345 tablet_service.cc:1514] Processing DeleteTablet for tablet d58e6d7e023345cba624523eb57e08d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:23 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34708
I20260811 18:53:23.809384 5032 tablet_replica.cc:330] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: stopping tablet replica
I20260811 18:53:23.809538 5034 tablet_replica.cc:330] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: stopping tablet replica
I20260811 18:53:23.809643 5034 raft_consensus.cc:2229] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:23.809736 5032 raft_consensus.cc:2229] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:23.809854 5032 raft_consensus.cc:2258] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:23.809943 5034 raft_consensus.cc:2258] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:23.810292 5034 ts_tablet_manager.cc:1905] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:23.812322 5034 ts_tablet_manager.cc:1918] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:53:23.812443 5034 log.cc:1196] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/d58e6d7e023345cba624523eb57e08d9
I20260811 18:53:23.812763 5034 ts_tablet_manager.cc:1939] T d58e6d7e023345cba624523eb57e08d9 P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting consensus metadata
I20260811 18:53:23.813118 4110 catalog_manager.cc:4841] TS fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193:34749): tablet d58e6d7e023345cba624523eb57e08d9 (table test-table [id=4783c88324db4d7893b2c6b2bbb49ebe]) successfully deleted
I20260811 18:53:23.813328 5030 tablet_replica.cc:330] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: stopping tablet replica
I20260811 18:53:23.813429 5030 raft_consensus.cc:2229] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:23.813582 5030 raft_consensus.cc:2258] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:23.813887 5030 ts_tablet_manager.cc:1905] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:23.815665 5030 ts_tablet_manager.cc:1918] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:53:23.815784 5030 log.cc:1196] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/d58e6d7e023345cba624523eb57e08d9
I20260811 18:53:23.816087 5030 ts_tablet_manager.cc:1939] T d58e6d7e023345cba624523eb57e08d9 P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting consensus metadata
I20260811 18:53:23.816946 4111 catalog_manager.cc:4841] TS 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281): tablet d58e6d7e023345cba624523eb57e08d9 (table test-table [id=4783c88324db4d7893b2c6b2bbb49ebe]) successfully deleted
I20260811 18:53:23.817186 5032 ts_tablet_manager.cc:1905] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:23.818629 5032 ts_tablet_manager.cc:1918] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:53:23.818708 5032 log.cc:1196] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/d58e6d7e023345cba624523eb57e08d9
I20260811 18:53:23.818954 5032 ts_tablet_manager.cc:1939] T d58e6d7e023345cba624523eb57e08d9 P 5420b72aba304bc38b382a78ecbebc06: Deleting consensus metadata
I20260811 18:53:23.819288 4112 catalog_manager.cc:4841] TS 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117): tablet d58e6d7e023345cba624523eb57e08d9 (table test-table [id=4783c88324db4d7893b2c6b2bbb49ebe]) successfully deleted
Aug 11 18:53:23 dist-test-slave-68xk krb5kdc[4067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 18:53:23 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:23 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:53:23.846550 5049 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:23.838771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59826 (local address 127.23.226.254:43063)
0811 18:53:23.838934 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.838937 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.839060 (+ 123us) server_negotiation.cc:407] Connection header received
0811 18:53:23.839120 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.839121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.839137 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.839217 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:23.839991 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.840881 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.841996 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.842323 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.842400 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.846363 (+ 3963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59826: BlockingRecv error: recv got EOF from 127.0.0.1:59826 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":58,"threads_started":1}
Aug 11 18:53:23 dist-test-slave-68xk krb5kdc[4067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM
I20260811 18:53:23.856087 5049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:23.847056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59842 (local address 127.23.226.254:43063)
0811 18:53:23.847106 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:23.847108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:23.847363 (+ 255us) server_negotiation.cc:407] Connection header received
0811 18:53:23.847415 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:23.847416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:23.847428 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:23.847495 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:23.848034 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.848791 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.849781 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:23.850099 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:23.850172 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:23.852953 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:23.852955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:23.852955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:23.852964 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:23.854766 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:23.855169 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:23.855170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:23.855170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:23.855243 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:23.855467 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:23.855468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:23.855468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:23.855606 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:23.855706 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:23.855871 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 18:53:23.855973 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:53:23.857847 4134 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:23.858032 4134 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:23.859521 4345 tablet_service.cc:1467] Processing CreateTablet for tablet f2dbb213039c441893b04e52140d57ba (DEFAULT_TABLE table=test-table [id=0ed734274a104f678e2421fcc265a17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.859668 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2dbb213039c441893b04e52140d57ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.859637 4574 tablet_service.cc:1467] Processing CreateTablet for tablet f2dbb213039c441893b04e52140d57ba (DEFAULT_TABLE table=test-table [id=0ed734274a104f678e2421fcc265a17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.859790 4574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2dbb213039c441893b04e52140d57ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.861363 4788 tablet_service.cc:1467] Processing CreateTablet for tablet f2dbb213039c441893b04e52140d57ba (DEFAULT_TABLE table=test-table [id=0ed734274a104f678e2421fcc265a17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:23.861496 4788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2dbb213039c441893b04e52140d57ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:23.862955 5063 tablet_bootstrap.cc:492] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: Bootstrap starting.
I20260811 18:53:23.863427 5062 tablet_bootstrap.cc:492] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: Bootstrap starting.
I20260811 18:53:23.863804 5063 tablet_bootstrap.cc:654] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.863993 5062 tablet_bootstrap.cc:654] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.864426 5058 tablet_bootstrap.cc:492] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: Bootstrap starting.
I20260811 18:53:23.864907 5058 tablet_bootstrap.cc:654] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:23.865193 5062 tablet_bootstrap.cc:492] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: No bootstrap required, opened a new log
I20260811 18:53:23.865290 5062 ts_tablet_manager.cc:1397] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:23.865489 5062 raft_consensus.cc:348] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.865657 5062 raft_consensus.cc:374] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.865734 5062 raft_consensus.cc:729] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5420b72aba304bc38b382a78ecbebc06, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.865854 5062 consensus_queue.cc:260] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.866047 5062 ts_tablet_manager.cc:1428] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:23.866997 5063 tablet_bootstrap.cc:492] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: No bootstrap required, opened a new log
I20260811 18:53:23.867063 5063 ts_tablet_manager.cc:1397] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 18:53:23.867123 5058 tablet_bootstrap.cc:492] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: No bootstrap required, opened a new log
I20260811 18:53:23.867183 5058 ts_tablet_manager.cc:1397] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 18:53:23.867246 5063 raft_consensus.cc:348] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.867332 5063 raft_consensus.cc:374] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.867295 5058 raft_consensus.cc:348] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.867353 5063 raft_consensus.cc:729] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a0e1ebed1d483d84e084bfd7f689f9, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.867367 5058 raft_consensus.cc:374] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:23.867389 5058 raft_consensus.cc:729] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Initialized, Role: FOLLOWER
I20260811 18:53:23.867439 5058 consensus_queue.cc:260] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.867560 5058 ts_tablet_manager.cc:1428] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:23.867713 5063 consensus_queue.cc:260] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:23.868031 5063 ts_tablet_manager.cc:1428] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:24.031291 4990 raft_consensus.cc:482] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:24.031440 4990 raft_consensus.cc:504] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.031800 4990 leader_election.cc:288] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117), 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:24.032083 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2dbb213039c441893b04e52140d57ba" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06" is_pre_election: true
I20260811 18:53:24.032133 4824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2dbb213039c441893b04e52140d57ba" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" is_pre_election: true
I20260811 18:53:24.032226 4824 raft_consensus.cc:2454] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 0.
I20260811 18:53:24.032224 4602 raft_consensus.cc:2454] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 0.
I20260811 18:53:24.032415 4270 leader_election.cc:302] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a0e1ebed1d483d84e084bfd7f689f9, fa6c5d7a19ad44a8a50dd01f768149d9; no voters:
I20260811 18:53:24.032542 4990 raft_consensus.cc:2781] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:24.032595 4990 raft_consensus.cc:482] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:24.032613 4990 raft_consensus.cc:3037] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:24.033479 4990 raft_consensus.cc:504] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.033699 4990 leader_election.cc:288] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117), 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:24.033895 4824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2dbb213039c441893b04e52140d57ba" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a0e1ebed1d483d84e084bfd7f689f9"
I20260811 18:53:24.033906 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2dbb213039c441893b04e52140d57ba" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06"
I20260811 18:53:24.033990 4602 raft_consensus.cc:3037] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:24.033994 4824 raft_consensus.cc:3037] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:24.034669 4602 raft_consensus.cc:2454] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 1.
I20260811 18:53:24.034852 4824 raft_consensus.cc:2454] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 1.
I20260811 18:53:24.034875 4273 leader_election.cc:302] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, fa6c5d7a19ad44a8a50dd01f768149d9; no voters:
I20260811 18:53:24.034987 4990 raft_consensus.cc:2781] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:24.035058 4990 raft_consensus.cc:686] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 LEADER]: Becoming Leader. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Running, Role: LEADER
I20260811 18:53:24.035107 4990 consensus_queue.cc:237] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.035878 4133 catalog_manager.cc:5495] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:24.046343 5005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:24.044007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34742 (local address 127.23.226.193:34749)
0811 18:53:24.044073 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:24.044077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:24.044090 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:53:24.044116 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:24.044117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:24.044161 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:24.044213 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:24.044360 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:24.044846 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:24.045704 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:24.045912 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:24.045969 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:24.046142 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:24.046168 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:24.046207 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:24.046273 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:53:24.046292 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:53:24.047204 4824 raft_consensus.cc:1261] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Refusing update from remote peer fa6c5d7a19ad44a8a50dd01f768149d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:24.047222 4602 raft_consensus.cc:1261] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Refusing update from remote peer fa6c5d7a19ad44a8a50dd01f768149d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:24.047431 4946 consensus_queue.cc:1035] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:24.047544 4990 consensus_queue.cc:1035] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:24.048992 5001 mvcc.cc:205] Tried to move back new op lower bound from 7317399158975606784 to 7317399158928232448. Current Snapshot: MvccSnapshot[applied={T|T < 7317399158975606784}]
I20260811 18:53:24.050343 4133 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:24.050484 4133 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:24.051105 4133 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: Sending DeleteTablet for 3 replicas of tablet f2dbb213039c441893b04e52140d57ba
I20260811 18:53:24.051374 4345 tablet_service.cc:1514] Processing DeleteTablet for tablet f2dbb213039c441893b04e52140d57ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:24 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34708
I20260811 18:53:24.051419 4574 tablet_service.cc:1514] Processing DeleteTablet for tablet f2dbb213039c441893b04e52140d57ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:24 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34516
I20260811 18:53:24.051450 4788 tablet_service.cc:1514] Processing DeleteTablet for tablet f2dbb213039c441893b04e52140d57ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:24 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:35556
I20260811 18:53:24.051481 5034 tablet_replica.cc:330] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: stopping tablet replica
I20260811 18:53:24.051505 5032 tablet_replica.cc:330] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: stopping tablet replica
I20260811 18:53:24.051535 5030 tablet_replica.cc:330] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: stopping tablet replica
I20260811 18:53:24.051544 5034 raft_consensus.cc:2229] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:24.051554 5032 raft_consensus.cc:2229] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:24.051591 5032 raft_consensus.cc:2258] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:24.051587 5030 raft_consensus.cc:2229] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:24.051609 5034 raft_consensus.cc:2258] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:24.051638 5030 raft_consensus.cc:2258] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:24.051977 5030 ts_tablet_manager.cc:1905] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:24.051973 5034 ts_tablet_manager.cc:1905] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:24.052121 4133 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:24.052294 4133 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:24.052596 5032 ts_tablet_manager.cc:1905] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:24.053757 5030 ts_tablet_manager.cc:1918] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:24.053761 5034 ts_tablet_manager.cc:1918] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:24.053822 5030 log.cc:1196] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/f2dbb213039c441893b04e52140d57ba
I20260811 18:53:24.053845 5034 log.cc:1196] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/f2dbb213039c441893b04e52140d57ba
I20260811 18:53:24.054051 5030 ts_tablet_manager.cc:1939] T f2dbb213039c441893b04e52140d57ba P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting consensus metadata
I20260811 18:53:24.054121 5034 ts_tablet_manager.cc:1939] T f2dbb213039c441893b04e52140d57ba P fa6c5d7a19ad44a8a50dd01f768149d9: Deleting consensus metadata
I20260811 18:53:24.054251 5032 ts_tablet_manager.cc:1918] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:24.054317 5032 log.cc:1196] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/f2dbb213039c441893b04e52140d57ba
I20260811 18:53:24.054580 5032 ts_tablet_manager.cc:1939] T f2dbb213039c441893b04e52140d57ba P 5420b72aba304bc38b382a78ecbebc06: Deleting consensus metadata
I20260811 18:53:24.054631 4110 catalog_manager.cc:4841] TS fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193:34749): tablet f2dbb213039c441893b04e52140d57ba (table test-table [id=0ed734274a104f678e2421fcc265a17f]) successfully deleted
I20260811 18:53:24.054967 4112 catalog_manager.cc:4841] TS 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117): tablet f2dbb213039c441893b04e52140d57ba (table test-table [id=0ed734274a104f678e2421fcc265a17f]) successfully deleted
I20260811 18:53:24.054986 4111 catalog_manager.cc:4841] TS 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281): tablet f2dbb213039c441893b04e52140d57ba (table test-table [id=0ed734274a104f678e2421fcc265a17f]) successfully deleted
I20260811 18:53:24.055470 4345 tablet_service.cc:1467] Processing CreateTablet for tablet 6656e97e4bb84879893eddbefed1f3de (DEFAULT_TABLE table=test-table [id=3346c6003703488ab70c5a09ac668381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:24.055473 4574 tablet_service.cc:1467] Processing CreateTablet for tablet 6656e97e4bb84879893eddbefed1f3de (DEFAULT_TABLE table=test-table [id=3346c6003703488ab70c5a09ac668381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:24.055505 4788 tablet_service.cc:1467] Processing CreateTablet for tablet 6656e97e4bb84879893eddbefed1f3de (DEFAULT_TABLE table=test-table [id=3346c6003703488ab70c5a09ac668381]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:24.055620 4788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6656e97e4bb84879893eddbefed1f3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:24.055634 4574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6656e97e4bb84879893eddbefed1f3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:24.055634 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6656e97e4bb84879893eddbefed1f3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:24.056773 5062 tablet_bootstrap.cc:492] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06: Bootstrap starting.
I20260811 18:53:24.056780 5058 tablet_bootstrap.cc:492] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9: Bootstrap starting.
I20260811 18:53:24.057117 5058 tablet_bootstrap.cc:654] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:24.057421 5063 tablet_bootstrap.cc:492] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: Bootstrap starting.
I20260811 18:53:24.057466 5062 tablet_bootstrap.cc:654] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:24.057755 5063 tablet_bootstrap.cc:654] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:24.058264 5062 tablet_bootstrap.cc:492] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06: No bootstrap required, opened a new log
I20260811 18:53:24.058336 5058 tablet_bootstrap.cc:492] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9: No bootstrap required, opened a new log
I20260811 18:53:24.058342 5062 ts_tablet_manager.cc:1397] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:24.058387 5058 ts_tablet_manager.cc:1397] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:24.058522 5058 raft_consensus.cc:348] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.058522 5062 raft_consensus.cc:348] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.058588 5058 raft_consensus.cc:374] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:24.058588 5062 raft_consensus.cc:374] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:24.058611 5058 raft_consensus.cc:729] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Initialized, Role: FOLLOWER
I20260811 18:53:24.058611 5062 raft_consensus.cc:729] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5420b72aba304bc38b382a78ecbebc06, State: Initialized, Role: FOLLOWER
I20260811 18:53:24.058655 5058 consensus_queue.cc:260] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.058673 5062 consensus_queue.cc:260] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.058756 5058 ts_tablet_manager.cc:1428] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:24.058758 5062 ts_tablet_manager.cc:1428] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:24.059161 5063 tablet_bootstrap.cc:492] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: No bootstrap required, opened a new log
I20260811 18:53:24.059202 5063 ts_tablet_manager.cc:1397] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:53:24.059320 5063 raft_consensus.cc:348] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.059401 5063 raft_consensus.cc:374] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:24.059422 5063 raft_consensus.cc:729] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a0e1ebed1d483d84e084bfd7f689f9, State: Initialized, Role: FOLLOWER
I20260811 18:53:24.059464 5063 consensus_queue.cc:260] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.059552 5063 ts_tablet_manager.cc:1428] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:24.240805 4946 raft_consensus.cc:482] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:24.240911 4946 raft_consensus.cc:504] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.241122 4946 leader_election.cc:288] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117), 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:24.241392 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6656e97e4bb84879893eddbefed1f3de" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06" is_pre_election: true
I20260811 18:53:24.241501 4602 raft_consensus.cc:2454] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 0.
I20260811 18:53:24.241439 4824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6656e97e4bb84879893eddbefed1f3de" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" is_pre_election: true
I20260811 18:53:24.241567 4824 raft_consensus.cc:2454] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 0.
I20260811 18:53:24.241716 4273 leader_election.cc:302] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, fa6c5d7a19ad44a8a50dd01f768149d9; no voters:
I20260811 18:53:24.241863 4946 raft_consensus.cc:2781] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:24.241916 4946 raft_consensus.cc:482] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:24.241945 4946 raft_consensus.cc:3037] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:24.242811 4946 raft_consensus.cc:504] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.242991 4946 leader_election.cc:288] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5420b72aba304bc38b382a78ecbebc06 (127.23.226.194:46117), 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281)
I20260811 18:53:24.243172 4824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6656e97e4bb84879893eddbefed1f3de" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a0e1ebed1d483d84e084bfd7f689f9"
I20260811 18:53:24.243192 4602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6656e97e4bb84879893eddbefed1f3de" candidate_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5420b72aba304bc38b382a78ecbebc06"
I20260811 18:53:24.243270 4602 raft_consensus.cc:3037] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:24.243274 4824 raft_consensus.cc:3037] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:24.243911 4602 raft_consensus.cc:2454] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 1.
I20260811 18:53:24.243978 4824 raft_consensus.cc:2454] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa6c5d7a19ad44a8a50dd01f768149d9 in term 1.
I20260811 18:53:24.244129 4273 leader_election.cc:302] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5420b72aba304bc38b382a78ecbebc06, fa6c5d7a19ad44a8a50dd01f768149d9; no voters:
I20260811 18:53:24.244237 4946 raft_consensus.cc:2781] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:24.244294 4946 raft_consensus.cc:686] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 LEADER]: Becoming Leader. State: Replica: fa6c5d7a19ad44a8a50dd01f768149d9, State: Running, Role: LEADER
I20260811 18:53:24.244349 4946 consensus_queue.cc:237] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } }
I20260811 18:53:24.244995 4133 catalog_manager.cc:5495] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa6c5d7a19ad44a8a50dd01f768149d9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 } health_report { overall_health: UNKNOWN } } }
I20260811 18:53:24.289031 5005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:24.286878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:52387 (local address 127.23.226.193:34749)
0811 18:53:24.286917 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:24.286920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:24.286928 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:53:24.286969 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:24.286970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:24.286979 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:24.287031 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:24.287161 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:24.287640 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:24.288364 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:24.288554 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:24.288625 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:24.288775 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:24.288811 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:24.288871 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:24.288928 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 18:53:24.288950 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":22}
I20260811 18:53:24.289130 5026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:24.286797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34749 (local address 127.23.226.193:52387)
0811 18:53:24.286857 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:24.286869 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:24.286913 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:24.287034 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:24.287034 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:24.287035 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 18:53:24.287087 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:24.287089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:24.287724 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:24.287725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:24.288267 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:24.288269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:24.288623 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:24.288623 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:24.288681 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:24.288686 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 18:53:24.288870 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 18:53:24.288872 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:53:24.288925 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:53:24.288994 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":3}
I20260811 18:53:24.290979 4824 raft_consensus.cc:1261] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Refusing update from remote peer fa6c5d7a19ad44a8a50dd01f768149d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:24.291129 4602 raft_consensus.cc:1261] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Refusing update from remote peer fa6c5d7a19ad44a8a50dd01f768149d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:24.291275 4990 consensus_queue.cc:1035] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a0e1ebed1d483d84e084bfd7f689f9" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 41281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:24.291430 4990 consensus_queue.cc:1035] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5420b72aba304bc38b382a78ecbebc06" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 46117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:24.302171 4134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:24.302301 4134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:24.303087 4134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a12edc6ed13b46e8a1896039e4022d34: Sending DeleteTablet for 3 replicas of tablet 6656e97e4bb84879893eddbefed1f3de
I20260811 18:53:24.303408 4788 tablet_service.cc:1514] Processing DeleteTablet for tablet 6656e97e4bb84879893eddbefed1f3de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:24 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:35556
I20260811 18:53:24.303442 4574 tablet_service.cc:1514] Processing DeleteTablet for tablet 6656e97e4bb84879893eddbefed1f3de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:24 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34516
I20260811 18:53:24.303429 4345 tablet_service.cc:1514] Processing DeleteTablet for tablet 6656e97e4bb84879893eddbefed1f3de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:24 UTC) from {username='oryx', principal='oryx/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34708
I20260811 18:53:24.303536 5032 tablet_replica.cc:330] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06: stopping tablet replica
I20260811 18:53:24.303555 5030 tablet_replica.cc:330] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: stopping tablet replica
I20260811 18:53:24.303587 5032 raft_consensus.cc:2229] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:24.303618 5032 raft_consensus.cc:2258] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:24.303623 5030 raft_consensus.cc:2229] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:24.303668 5030 raft_consensus.cc:2258] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:24.303750 5034 tablet_replica.cc:330] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9: stopping tablet replica
I20260811 18:53:24.303828 5034 raft_consensus.cc:2229] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:24.303896 5034 raft_consensus.cc:2258] T 6656e97e4bb84879893eddbefed1f3de P fa6c5d7a19ad44a8a50dd01f768149d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:24.303931 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 4244
I20260811 18:53:24.308884 5030 ts_tablet_manager.cc:1905] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:24.310849 5030 ts_tablet_manager.cc:1918] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 18:53:24.310932 5030 log.cc:1196] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/6656e97e4bb84879893eddbefed1f3de
I20260811 18:53:24.311196 5030 ts_tablet_manager.cc:1939] T 6656e97e4bb84879893eddbefed1f3de P 75a0e1ebed1d483d84e084bfd7f689f9: Deleting consensus metadata
I20260811 18:53:24.311645 4111 catalog_manager.cc:4841] TS 75a0e1ebed1d483d84e084bfd7f689f9 (127.23.226.195:41281): tablet 6656e97e4bb84879893eddbefed1f3de (table test-table [id=3346c6003703488ab70c5a09ac668381]) successfully deleted
I20260811 18:53:24.318837 5032 ts_tablet_manager.cc:1905] T 6656e97e4bb84879893eddbefed1f3de P 5420b72aba304bc38b382a78ecbebc06: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 18:53:24.319314 4110 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:34749 (error 108)
I20260811 18:53:24.319694 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 4469
I20260811 18:53:24.319932 5086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:24.319722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34749 (local address 127.0.0.1:34750)
0811 18:53:24.319831 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:24.319879 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:34749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":47,"threads_started":1}
W20260811 18:53:24.320163 4110 catalog_manager.cc:4584] TS fa6c5d7a19ad44a8a50dd01f768149d9 (127.23.226.193:34749): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6656e97e4bb84879893eddbefed1f3de: Network error: Client connection negotiation failed: client connection to 127.23.226.193:34749: connect: Connection refused (error 111)
I20260811 18:53:24.331550 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 4689
I20260811 18:53:24.331650 5086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:24.331487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:46117 (local address 127.0.0.1:34530)
0811 18:53:24.331572 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:24.331615 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.194:46117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 18:53:24.344699 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 4085
2026-08-11T18:53:24Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3426 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:24 dist-test-slave-68xk krb5kdc[5089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:24 dist-test-slave-68xk krb5kdc[5089](info): set up 2 sockets
Aug 11 18:53:24 dist-test-slave-68xk krb5kdc[5089](info): commencing operation
krb5kdc: starting...
W20260811 18:53:25.603058 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:25 dist-test-slave-68xk krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:53:25.734062 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:43489
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:43489
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:25.817101 5103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:25.817312 5103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:25.817334 5103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:25.818430 5103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:25.818511 5103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:25.818534 5103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:25.818555 5103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:25.818588 5103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:25.820099 5103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:43489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:43489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:25.820451 5103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:25.820701 5103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:25.825562 5114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:25.825721 5111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:25.825562 5110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:25.825868 5103 server_base.cc:1034] running on GCE node
I20260811 18:53:25.826092 5103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:25.826341 5103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:25.827497 5103 hybrid_clock.cc:648] HybridClock initialized: now 1786474405827469 us; error 50 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T18:53:25Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1487 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:25 dist-test-slave-68xk krb5kdc[5121](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:25 dist-test-slave-68xk krb5kdc[5121](info): set up 2 sockets
Aug 11 18:53:25 dist-test-slave-68xk krb5kdc[5121](info): commencing operation
krb5kdc: starting...
W20260811 18:53:27.198268 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.335s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:27 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:53:27.329177 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:40395
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:40395
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:27.418262 5137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:27.418550 5137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:27.418591 5137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:27.419832 5137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:27.419920 5137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:27.419945 5137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:27.419967 5137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:27.419997 5137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:27.421522 5137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:40395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:40395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:27.421813 5137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:27.422063 5137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:27.427485 5145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:27.427498 5142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:27.427500 5148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:27.427517 5137 server_base.cc:1034] running on GCE node
I20260811 18:53:27.428056 5137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:27.428383 5137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:27.429584 5137 hybrid_clock.cc:648] HybridClock initialized: now 1786474407429533 us; error 64 us; skew 500 ppm
Aug 11 18:53:27 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:27.432544 5137 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:53:27.433071 5137 webserver.cc:460] Webserver started at http://127.23.226.254:38005/ using document root <none> and password file <none>
I20260811 18:53:27.433314 5137 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:27.433424 5137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:27.433614 5137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:27.434834 5137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "c378a21d9be44a8db8b4eb3195e771cd"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "1262584c50e71e33cf900f04729d7e6d"
server_key_iv: "90d7ee3e52ddd23a883cacde758f6cad"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.435214 5137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "c378a21d9be44a8db8b4eb3195e771cd"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "1262584c50e71e33cf900f04729d7e6d"
server_key_iv: "90d7ee3e52ddd23a883cacde758f6cad"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.436605 5137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:27.437395 5157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:27.437578 5137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:27.437690 5137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "c378a21d9be44a8db8b4eb3195e771cd"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "1262584c50e71e33cf900f04729d7e6d"
server_key_iv: "90d7ee3e52ddd23a883cacde758f6cad"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.437768 5137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:27.472210 5137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:27.474773 5137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:27.474961 5137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:27.479287 5137 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:40395
I20260811 18:53:27.479326 5233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:40395 every 8 connection(s)
I20260811 18:53:27.479738 5137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:27.480688 5234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:27.483093 5234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Bootstrap starting.
I20260811 18:53:27.483716 5234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:27.484026 5234 log.cc:824] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:27.484828 5234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: No bootstrap required, opened a new log
I20260811 18:53:27.485487 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 5137
I20260811 18:53:27.485651 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:27.485860 24459 external_mini_cluster.cc:1428] Setting key 384872667acd3419e5ba252e58b75447
I20260811 18:53:27.487141 5234 raft_consensus.cc:348] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } }
I20260811 18:53:27.487306 5234 raft_consensus.cc:374] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:27.487371 5234 raft_consensus.cc:729] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c378a21d9be44a8db8b4eb3195e771cd, State: Initialized, Role: FOLLOWER
I20260811 18:53:27.487515 5234 consensus_queue.cc:260] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } }
I20260811 18:53:27.487598 5234 raft_consensus.cc:388] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:27.487629 5234 raft_consensus.cc:482] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:27.487668 5234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:27.488572 5234 raft_consensus.cc:504] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } }
I20260811 18:53:27.488667 5234 leader_election.cc:302] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c378a21d9be44a8db8b4eb3195e771cd; no voters:
I20260811 18:53:27.488899 5234 leader_election.cc:288] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:27.488926 5242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:27.489042 5242 raft_consensus.cc:686] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 1 LEADER]: Becoming Leader. State: Replica: c378a21d9be44a8db8b4eb3195e771cd, State: Running, Role: LEADER
I20260811 18:53:27.489144 5242 consensus_queue.cc:237] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } }
I20260811 18:53:27.489209 5234 sys_catalog.cc:564] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:27.489478 5242 sys_catalog.cc:455] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c378a21d9be44a8db8b4eb3195e771cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } } }
I20260811 18:53:27.489562 5242 sys_catalog.cc:458] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:27.489707 5242 sys_catalog.cc:455] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c378a21d9be44a8db8b4eb3195e771cd. Latest consensus state: current_term: 1 leader_uuid: "c378a21d9be44a8db8b4eb3195e771cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } } }
I20260811 18:53:27.489778 5242 sys_catalog.cc:458] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:27.489915 5248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:27.490734 5248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:27.493029 5248 catalog_manager.cc:1347] Generated new cluster ID: c98f695d6027488ea7c3a39ef5d77e82
I20260811 18:53:27.493091 5248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:53:27 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:27.497927 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:27.486474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38706 (local address 127.23.226.254:40395)
0811 18:53:27.486690 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:27.486699 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:27.486725 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:53:27.487122 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:27.487128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:27.487177 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:27.487311 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:27.488094 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.489233 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.490585 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.491241 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.491366 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:27.494097 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:27.494101 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:27.494101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:27.494113 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:27.495893 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:27.496288 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:27.496292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:27.496292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:27.496411 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:27.496631 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:27.496632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:27.496633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:27.496884 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:27.497602 (+ 718us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:27.497666 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 18:53:27.497779 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":93,"threads_started":1}
I20260811 18:53:27.516578 5248 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:27.517315 5248 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:27.530707 5248 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Generated new TSK 0
I20260811 18:53:27.530916 5248 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:53:27.566501 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40395
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:27.652935 5273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:27.653151 5273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:27.653177 5273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:27.654342 5273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:27.654387 5273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:27.654430 5273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:27.655906 5273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:27.656169 5273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:27.656409 5273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:27.661577 5282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:27.661594 5286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:27.661609 5283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:27.661916 5273 server_base.cc:1034] running on GCE node
I20260811 18:53:27.662150 5273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:27.662470 5273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:27.663631 5273 hybrid_clock.cc:648] HybridClock initialized: now 1786474407663613 us; error 36 us; skew 500 ppm
Aug 11 18:53:27 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:27.666558 5273 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:53:27.667029 5273 webserver.cc:460] Webserver started at http://127.23.226.193:37917/ using document root <none> and password file <none>
I20260811 18:53:27.667291 5273 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:27.667338 5273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:27.667486 5273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:27.668606 5273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "50c2046367a74464ac35032c83466ba9"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "7b33beb9b6a9a820ccd3ad983afc3544"
server_key_iv: "1e5e2071c9032ae334919b52cdda5827"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.668989 5273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "50c2046367a74464ac35032c83466ba9"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "7b33beb9b6a9a820ccd3ad983afc3544"
server_key_iv: "1e5e2071c9032ae334919b52cdda5827"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.670492 5273 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:27.671329 5297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:27.671525 5273 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:27.671623 5273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "50c2046367a74464ac35032c83466ba9"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "7b33beb9b6a9a820ccd3ad983afc3544"
server_key_iv: "1e5e2071c9032ae334919b52cdda5827"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.671700 5273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:27.684126 5273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:27.686220 5273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:27.686395 5273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:27.686740 5273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:27.687083 5273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:27.687150 5273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:27.687196 5273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:27.687227 5273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:27.693616 5273 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:40061
I20260811 18:53:27.693703 5455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:40061 every 8 connection(s)
I20260811 18:53:27.694044 5273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:53:27 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:27.702984 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 5273
I20260811 18:53:27.703110 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:27.703298 24459 external_mini_cluster.cc:1428] Setting key 511994939c83820ae6f987b210d61f6e
I20260811 18:53:27.704114 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:27.694880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:36613 (local address 127.23.226.254:40395)
0811 18:53:27.694952 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:27.694954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:27.695243 (+ 289us) server_negotiation.cc:407] Connection header received
0811 18:53:27.695777 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:27.695778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:27.695793 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:27.695861 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:27.696896 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.697418 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.698484 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.698729 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.698793 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:27.701172 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:27.701174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:27.701174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:27.701183 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:27.702568 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:27.702980 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:27.702981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:27.702982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:27.703051 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:27.703353 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:27.703354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:27.703355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:27.703500 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:27.703571 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:27.703928 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 18:53:27.704034 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:53:27.704425 5459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:27.694853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:36613)
0811 18:53:27.695045 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:27.695149 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:27.695654 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:27.695944 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:27.695948 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:27.696572 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:27.696783 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:27.696788 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.697514 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.697515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:27.698350 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:27.698352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.698819 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.698820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:27.698949 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:27.699489 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:27.699499 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:27.701049 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:27.702645 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:27.702653 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:27.702655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:27.702886 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:27.703126 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:27.703127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:27.703128 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:27.703278 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:27.703590 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:27.703599 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:27.703758 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 18:53:27.703889 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 18:53:27.704094 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":113,"threads_started":1}
I20260811 18:53:27.704938 5456 heartbeater.cc:347] Connected to a master server at 127.23.226.254:40395
I20260811 18:53:27.705080 5456 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:27.705272 5456 heartbeater.cc:511] Master 127.23.226.254:40395 requested a full tablet report, sending...
I20260811 18:53:27.705883 5181 ts_manager.cc:194] Registered new tserver with Master: 50c2046367a74464ac35032c83466ba9 (127.23.226.193:40061)
I20260811 18:53:27.706858 5181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:36613
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:53:27.733774 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40395
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:27.818307 5465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:27.818578 5465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:27.818617 5465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:27.819779 5465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:27.819850 5465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:27.819905 5465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:27.821395 5465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:27.821676 5465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:27.821916 5465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:27.827024 5473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:27.827118 5472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:27.827028 5475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:27.827343 5465 server_base.cc:1034] running on GCE node
I20260811 18:53:27.827602 5465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:27.827872 5465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:27.829042 5465 hybrid_clock.cc:648] HybridClock initialized: now 1786474407829007 us; error 51 us; skew 500 ppm
Aug 11 18:53:27 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:27.831732 5465 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:53:27.832120 5465 webserver.cc:460] Webserver started at http://127.23.226.194:44601/ using document root <none> and password file <none>
I20260811 18:53:27.832315 5465 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:27.832358 5465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:27.832451 5465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:27.833472 5465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "c26759e3858340e9a9140d18cf5d5063"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "e369e6a01b1250c876230b72335191ad"
server_key_iv: "b0c9114626ee22836e9bc9959b993a68"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.833791 5465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "c26759e3858340e9a9140d18cf5d5063"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "e369e6a01b1250c876230b72335191ad"
server_key_iv: "b0c9114626ee22836e9bc9959b993a68"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.835444 5465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:53:27.836491 5484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:27.836678 5465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:27.836805 5465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "c26759e3858340e9a9140d18cf5d5063"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "e369e6a01b1250c876230b72335191ad"
server_key_iv: "b0c9114626ee22836e9bc9959b993a68"
server_key_version: "encryptionkey@0"
I20260811 18:53:27.836894 5465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:27.852432 5465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:27.854880 5465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:27.855057 5465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:27.855319 5465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:27.855654 5465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:27.855711 5465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:27.855775 5465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:27.855821 5465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:27.862315 5465 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:34291
I20260811 18:53:27.862469 5634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:34291 every 8 connection(s)
I20260811 18:53:27.862777 5465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:53:27 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:27.869879 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 5465
I20260811 18:53:27.869987 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:27.870224 24459 external_mini_cluster.cc:1428] Setting key c943cc8a31387ae25c092158197bbb87
I20260811 18:53:27.873301 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:27.863575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:33975 (local address 127.23.226.254:40395)
0811 18:53:27.863662 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:27.863665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:27.863928 (+ 263us) server_negotiation.cc:407] Connection header received
0811 18:53:27.864423 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:27.864424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:27.864434 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:27.864488 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:27.865453 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.865972 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.867155 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.867420 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.867486 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:27.869818 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:27.869821 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:27.869821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:27.869831 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:27.871561 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:27.872190 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:27.872192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:27.872192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:27.872262 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:27.872583 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:27.872583 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:27.872584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:27.872698 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:27.872755 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:27.873150 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 18:53:27.873235 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:53:27.873556 5637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:27.863563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:33975)
0811 18:53:27.863788 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:27.863827 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:27.864336 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:27.864541 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:27.864545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:27.865154 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:27.865350 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:27.865356 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.866096 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.866098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:27.867047 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:27.867050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:27.867529 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:27.867530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:27.867662 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:27.868226 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:27.868236 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:27.869688 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:27.871660 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:27.871670 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:27.871672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:27.872034 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:27.872346 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:27.872347 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:27.872347 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:27.872511 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:27.872767 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:27.872775 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:27.872964 (+ 189us) client_negotiation.cc:769] Sending connection context
0811 18:53:27.873088 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 18:53:27.873307 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":111,"threads_started":1}
I20260811 18:53:27.874101 5635 heartbeater.cc:347] Connected to a master server at 127.23.226.254:40395
I20260811 18:53:27.874218 5635 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:27.874460 5635 heartbeater.cc:511] Master 127.23.226.254:40395 requested a full tablet report, sending...
I20260811 18:53:27.874943 5181 ts_manager.cc:194] Registered new tserver with Master: c26759e3858340e9a9140d18cf5d5063 (127.23.226.194:34291)
I20260811 18:53:27.875330 5181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:33975
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:53:27.902362 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40395
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:27.987054 5641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:27.987265 5641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:27.987289 5641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:27.988431 5641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:27.988473 5641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:27.988499 5641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:27.990105 5641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:27.990375 5641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:27.990669 5641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:27.996146 5650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:27.996193 5641 server_base.cc:1034] running on GCE node
W20260811 18:53:27.996279 5649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:27.996193 5653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:27.996618 5641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:27.996867 5641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:27.998059 5641 hybrid_clock.cc:648] HybridClock initialized: now 1786474407998041 us; error 32 us; skew 500 ppm
Aug 11 18:53:27 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:28.000775 5641 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:53:28.001228 5641 webserver.cc:460] Webserver started at http://127.23.226.195:34051/ using document root <none> and password file <none>
I20260811 18:53:28.001415 5641 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:28.001454 5641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:28.001546 5641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:28.002609 5641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "3ff8c9c9410c4920a589b70bcc9c0290"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "e69038fd1bc2b33a7ba0c8ba1a9e8f46"
server_key_iv: "7e26fea81e853d1a15ecd071f386e1b9"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.002924 5641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "3ff8c9c9410c4920a589b70bcc9c0290"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "e69038fd1bc2b33a7ba0c8ba1a9e8f46"
server_key_iv: "7e26fea81e853d1a15ecd071f386e1b9"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.004374 5641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:28.005375 5661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.005632 5641 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:28.005741 5641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "3ff8c9c9410c4920a589b70bcc9c0290"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "e69038fd1bc2b33a7ba0c8ba1a9e8f46"
server_key_iv: "7e26fea81e853d1a15ecd071f386e1b9"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.005807 5641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:28.030558 5641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:28.032940 5641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:28.033074 5641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:28.033303 5641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:28.033675 5641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:28.033715 5641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.033766 5641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:28.033797 5641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.040488 5641 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:40383
I20260811 18:53:28.040609 5824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:40383 every 8 connection(s)
I20260811 18:53:28.040978 5641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474407, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:28.048561 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 5641
I20260811 18:53:28.048682 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:28.048877 24459 external_mini_cluster.cc:1428] Setting key ccba12d731e89910518ae29030b4a56c
I20260811 18:53:28.051890 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.041789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:36939 (local address 127.23.226.254:40395)
0811 18:53:28.041878 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.041880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.042133 (+ 253us) server_negotiation.cc:407] Connection header received
0811 18:53:28.042760 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.042762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.042773 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.042831 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.043910 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.044469 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.045603 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.045801 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.045881 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.048414 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:28.048416 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:28.048416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:28.048425 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:28.050335 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.050825 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.050827 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.050827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.050908 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.051220 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.051221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.051221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.051345 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:28.051399 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:28.051735 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 18:53:28.051820 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:53:28.052003 5830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.041776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:36939)
0811 18:53:28.041979 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.042021 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.042654 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.042890 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.042894 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.043530 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.043770 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.043775 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.044592 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.044593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.045491 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.045494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.045901 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.045901 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.046007 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.046675 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.046685 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.048292 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:28.050408 (+ 2116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.050461 (+ 53us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.050463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.050744 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.051006 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:28.051007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:28.051008 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:28.051132 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:28.051408 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:28.051414 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:28.051553 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 18:53:28.051642 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:53:28.051785 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":114,"threads_started":1}
I20260811 18:53:28.052521 5826 heartbeater.cc:347] Connected to a master server at 127.23.226.254:40395
I20260811 18:53:28.052616 5826 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:28.052789 5826 heartbeater.cc:511] Master 127.23.226.254:40395 requested a full tablet report, sending...
I20260811 18:53:28.053143 5181 ts_manager.cc:194] Registered new tserver with Master: 3ff8c9c9410c4920a589b70bcc9c0290 (127.23.226.195:40383)
I20260811 18:53:28.053562 5181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:36939
I20260811 18:53:28.060993 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab.
Entry for principal oryx/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab.
WARNING: no policy specified for oryx/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab.
Entry for principal oryx/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab.
WARNING: no policy specified for oryx/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab.
Entry for principal oryx/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab.
I20260811 18:53:28.145889 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 5273
I20260811 18:53:28.166574 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 5465
I20260811 18:53:28.180253 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 5641
I20260811 18:53:28.195771 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 5137
I20260811 18:53:28.203995 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:40395
--webserver_interface=127.23.226.254
--webserver_port=38005
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:40395
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:28.288470 5839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:28.288691 5839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:28.288715 5839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:28.289915 5839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:28.289963 5839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:28.289978 5839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:28.289990 5839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:28.290002 5839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:28.291556 5839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:40395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:40395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=38005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:28.291836 5839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:28.292081 5839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:28.297348 5849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.297399 5846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.297408 5847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:28.297573 5839 server_base.cc:1034] running on GCE node
I20260811 18:53:28.297923 5839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:28.298247 5839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:28.299393 5839 hybrid_clock.cc:648] HybridClock initialized: now 1786474408299370 us; error 51 us; skew 500 ppm
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:28.302032 5839 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:53:28.302552 5839 webserver.cc:460] Webserver started at http://127.23.226.254:38005/ using document root <none> and password file <none>
I20260811 18:53:28.302809 5839 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:28.302902 5839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:28.304368 5839 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:28.305190 5858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.305460 5839 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:28.305606 5839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "c378a21d9be44a8db8b4eb3195e771cd"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "1262584c50e71e33cf900f04729d7e6d"
server_key_iv: "90d7ee3e52ddd23a883cacde758f6cad"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.305989 5839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:28.319690 5839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:28.322186 5839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:28.322386 5839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:28.327135 5839 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:40395
I20260811 18:53:28.327260 5932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:40395 every 8 connection(s)
I20260811 18:53:28.327812 5839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:28.329176 5933 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:53:28.329805 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 5839
I20260811 18:53:28.329866 5933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Bootstrap starting.
I20260811 18:53:28.330156 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:40061
--local_ip_for_outbound_sockets=127.23.226.193
--tserver_master_addrs=127.23.226.254:40395
--webserver_port=37917
--webserver_interface=127.23.226.193
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.226.193
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:53:28.339877 5933 log.cc:824] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:28.341718 5933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:53:28.342054 5933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Bootstrap complete.
I20260811 18:53:28.344568 5933 raft_consensus.cc:348] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } }
I20260811 18:53:28.344807 5933 raft_consensus.cc:729] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c378a21d9be44a8db8b4eb3195e771cd, State: Initialized, Role: FOLLOWER
I20260811 18:53:28.344991 5933 consensus_queue.cc:260] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } }
I20260811 18:53:28.345086 5933 raft_consensus.cc:388] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:28.345139 5933 raft_consensus.cc:482] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:28.345191 5933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:53:28.346226 5933 raft_consensus.cc:504] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } }
I20260811 18:53:28.346323 5933 leader_election.cc:302] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c378a21d9be44a8db8b4eb3195e771cd; no voters:
I20260811 18:53:28.346593 5933 leader_election.cc:288] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:53:28.346629 5939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:53:28.346768 5939 raft_consensus.cc:686] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [term 2 LEADER]: Becoming Leader. State: Replica: c378a21d9be44a8db8b4eb3195e771cd, State: Running, Role: LEADER
I20260811 18:53:28.346891 5933 sys_catalog.cc:564] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:28.346873 5939 consensus_queue.cc:237] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } }
I20260811 18:53:28.347249 5941 sys_catalog.cc:455] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c378a21d9be44a8db8b4eb3195e771cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } } }
I20260811 18:53:28.347259 5942 sys_catalog.cc:455] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c378a21d9be44a8db8b4eb3195e771cd. Latest consensus state: current_term: 2 leader_uuid: "c378a21d9be44a8db8b4eb3195e771cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c378a21d9be44a8db8b4eb3195e771cd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40395 } } }
I20260811 18:53:28.347434 5941 sys_catalog.cc:458] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:28.347457 5942 sys_catalog.cc:458] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:28.348031 5951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:28.348578 5951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:28.348718 5951 catalog_manager.cc:1259] Loaded cluster ID: c98f695d6027488ea7c3a39ef5d77e82
I20260811 18:53:28.348762 5951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:28.349913 5951 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:28.350102 5951 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c378a21d9be44a8db8b4eb3195e771cd: Loaded TSK: 0
I20260811 18:53:28.350322 5951 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:53:28.423581 5936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:28.423856 5936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:28.423906 5936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:28.425318 5936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:28.425398 5936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:28.425454 5936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:28.427354 5936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.193.keytab
--principal=oryx/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:40061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=37917
--tserver_master_addrs=127.23.226.254:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:28.427661 5936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:28.427942 5936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:28.434399 5976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.434470 5969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.434399 5972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:28.434826 5936 server_base.cc:1034] running on GCE node
I20260811 18:53:28.435043 5936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:28.435355 5936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:28.436533 5936 hybrid_clock.cc:648] HybridClock initialized: now 1786474408436505 us; error 47 us; skew 500 ppm
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:28.439635 5936 init.cc:377] Logged in from keytab as oryx/127.23.226.193@KRBTEST.COM (short username oryx)
I20260811 18:53:28.440178 5936 webserver.cc:460] Webserver started at http://127.23.226.193:37917/ using document root <none> and password file <none>
I20260811 18:53:28.440428 5936 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:28.440516 5936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:28.442143 5936 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:28.443015 5987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.443262 5936 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:28.443397 5936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "50c2046367a74464ac35032c83466ba9"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "7b33beb9b6a9a820ccd3ad983afc3544"
server_key_iv: "1e5e2071c9032ae334919b52cdda5827"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.443853 5936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:28.461833 5936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:28.464558 5936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:28.464761 5936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:28.465091 5936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:28.465485 5936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:28.465549 5936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.465597 5936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:28.465665 5936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.473732 5936 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:40061
I20260811 18:53:28.473861 6141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:40061 every 8 connection(s)
I20260811 18:53:28.474223 5936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:28.477145 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 5936
I20260811 18:53:28.477502 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:34291
--local_ip_for_outbound_sockets=127.23.226.194
--tserver_master_addrs=127.23.226.254:40395
--webserver_port=44601
--webserver_interface=127.23.226.194
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.226.194
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.484364 6144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.475073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:59651)
0811 18:53:28.475320 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.475363 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.475958 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.476472 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.476476 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.477262 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.477536 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.477543 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.478860 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.478861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.480173 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.480177 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.481070 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.481071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.481176 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.481764 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.481773 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.484208 (+ 2435us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":83,"threads_started":1}
W20260811 18:53:28.484628 6142 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:40395 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.226.254:40395: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
W20260811 18:53:28.484655 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.475224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:59651 (local address 127.23.226.254:40395)
0811 18:53:28.475434 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.475444 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.475488 (+ 44us) server_negotiation.cc:407] Connection header received
0811 18:53:28.476200 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.476207 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.476254 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.476390 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.477693 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.478747 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.480284 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.480954 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.481088 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.484411 (+ 3323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:59651: BlockingRecv error: recv got EOF from 127.23.226.193:59651 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":115,"threads_started":1}
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.489357 6144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.484858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:58047)
0811 18:53:28.485027 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.485036 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.485115 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.485284 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.485285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.485421 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.485466 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.485467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.486108 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.486109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.486677 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.486679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.487063 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.487064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.487152 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.487589 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.487596 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.489309 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":98,"threads_started":1}
W20260811 18:53:28.489532 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.484942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:58047 (local address 127.23.226.254:40395)
0811 18:53:28.485012 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.485014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.485104 (+ 90us) server_negotiation.cc:407] Connection header received
0811 18:53:28.485178 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.485179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.485192 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.485279 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.485555 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.486024 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.486782 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.486986 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.487065 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.489446 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:58047: BlockingRecv error: recv got EOF from 127.23.226.193:58047 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.494668 6144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.489761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:32895)
0811 18:53:28.489808 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.489821 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.489862 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.490051 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.490052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.490161 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.490187 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.490189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.491195 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.491196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.491702 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.491703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.492222 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.492223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.492306 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.492733 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.492745 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.494620 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 18:53:28.494794 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.489840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:32895 (local address 127.23.226.254:40395)
0811 18:53:28.489904 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.489906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.489917 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:28.489945 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.489946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.489958 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.490034 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.490262 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.491110 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.491789 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.492117 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.492213 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.494732 (+ 2519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:32895: BlockingRecv error: recv got EOF from 127.23.226.193:32895 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 18:53:28.494861 6142 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:53:28.566740 6147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:28.566943 6147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:28.566967 6147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:28.568095 6147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:28.568130 6147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:28.568156 6147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:28.569572 6147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.194.keytab
--principal=oryx/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:34291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=44601
--tserver_master_addrs=127.23.226.254:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:28.569769 6147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:28.569945 6147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:28.575438 6155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.575419 6158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.575438 6156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:28.575680 6147 server_base.cc:1034] running on GCE node
I20260811 18:53:28.575959 6147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:28.576261 6147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:28.577425 6147 hybrid_clock.cc:648] HybridClock initialized: now 1786474408577414 us; error 30 us; skew 500 ppm
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:28.580049 6147 init.cc:377] Logged in from keytab as oryx/127.23.226.194@KRBTEST.COM (short username oryx)
I20260811 18:53:28.580456 6147 webserver.cc:460] Webserver started at http://127.23.226.194:44601/ using document root <none> and password file <none>
I20260811 18:53:28.580713 6147 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:28.580775 6147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:28.582231 6147 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:28.582945 6168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.583226 6147 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:28.583343 6147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "c26759e3858340e9a9140d18cf5d5063"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "e369e6a01b1250c876230b72335191ad"
server_key_iv: "b0c9114626ee22836e9bc9959b993a68"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.583706 6147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:28.608373 6147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:28.611397 6147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:28.611580 6147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:28.611824 6147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:28.612196 6147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:28.612264 6147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.612310 6147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:28.612337 6147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.618709 6147 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:34291
I20260811 18:53:28.618758 6333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:34291 every 8 connection(s)
I20260811 18:53:28.619118 6147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:28.624406 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 6147
I20260811 18:53:28.624768 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:40383
--local_ip_for_outbound_sockets=127.23.226.195
--tserver_master_addrs=127.23.226.254:40395
--webserver_port=34051
--webserver_interface=127.23.226.195
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.23.226.195
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.627458 6337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.619973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:40503)
0811 18:53:28.620175 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.620213 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.620711 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.620934 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.620938 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.621517 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.621723 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.621729 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.622469 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.622469 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.623298 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.623301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.623711 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.623712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.623832 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.624397 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.624408 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.627299 (+ 2891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":118,"threads_started":1}
W20260811 18:53:28.627547 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.619973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:40503 (local address 127.23.226.254:40395)
0811 18:53:28.620045 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.620047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.620326 (+ 279us) server_negotiation.cc:407] Connection header received
0811 18:53:28.620801 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.620803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.620818 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.620871 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.621823 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.622327 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.623407 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.623603 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.623677 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.627462 (+ 3785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:40503: BlockingRecv error: recv got EOF from 127.23.226.194:40503 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 18:53:28.627792 6334 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:40395 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.226.254:40395: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.632887 6337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.628085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:34235)
0811 18:53:28.628130 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.628140 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.628191 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.628346 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.628347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.628486 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.628534 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.628536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.629212 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.629213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.629909 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.629913 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.630272 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.630273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.630348 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.630896 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.630901 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.632790 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 18:53:28.632925 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.628145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:34235 (local address 127.23.226.254:40395)
0811 18:53:28.628213 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.628215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.628224 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:28.628255 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.628255 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.628265 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.628341 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.628624 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.629119 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.630000 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.630199 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.630274 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.632879 (+ 2605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:34235: BlockingRecv error: recv got EOF from 127.23.226.194:34235 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.638266 6337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.633250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:41973)
0811 18:53:28.633378 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.633391 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.633450 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.633602 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.633603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.633764 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.633804 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.633806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.634398 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.634399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.635303 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.635306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.635691 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.635692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.635757 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.636165 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.636171 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.638199 (+ 2028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109}
W20260811 18:53:28.638401 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.633326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:41973 (local address 127.23.226.254:40395)
0811 18:53:28.633384 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.633386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.633434 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:53:28.633512 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.633512 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.633520 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.633565 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.633882 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.634319 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.635420 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.635602 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.635669 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.638297 (+ 2628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:41973: BlockingRecv error: recv got EOF from 127.23.226.194:41973 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 18:53:28.638438 6334 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:53:28.712129 6339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:28.712340 6339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:28.712364 6339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:28.713446 6339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:28.713479 6339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:28.713505 6339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:28.715014 6339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/krb5kdc/oryx_127.23.226.195.keytab
--principal=oryx/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:40383
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=34051
--tserver_master_addrs=127.23.226.254:40395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:28.715222 6339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:28.715396 6339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:28.720927 6346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:28.720963 6350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:28.720983 6339 server_base.cc:1034] running on GCE node
W20260811 18:53:28.720990 6345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:28.721329 6339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:28.721624 6339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:28.722816 6339 hybrid_clock.cc:648] HybridClock initialized: now 1786474408722805 us; error 35 us; skew 500 ppm
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474408, etypes {rep=17 tkt=17 ses=17}, oryx/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:28.725822 6339 init.cc:377] Logged in from keytab as oryx/127.23.226.195@KRBTEST.COM (short username oryx)
I20260811 18:53:28.726361 6339 webserver.cc:460] Webserver started at http://127.23.226.195:34051/ using document root <none> and password file <none>
I20260811 18:53:28.726652 6339 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:28.726755 6339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:28.728219 6339 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:28.728905 6360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.729099 6339 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:28.729255 6339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "3ff8c9c9410c4920a589b70bcc9c0290"
format_stamp: "Formatted at 2026-08-11 18:53:27 on dist-test-slave-68xk"
server_key: "e69038fd1bc2b33a7ba0c8ba1a9e8f46"
server_key_iv: "7e26fea81e853d1a15ecd071f386e1b9"
server_key_version: "encryptionkey@0"
I20260811 18:53:28.729614 6339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:28.764803 6339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:28.767221 6339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:28.767393 6339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:28.767647 6339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:28.767977 6339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:28.768033 6339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.768080 6339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:28.768119 6339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:28.774235 6339 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:40383
I20260811 18:53:28.774300 6519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:40383 every 8 connection(s)
I20260811 18:53:28.774705 6339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.781848 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 6339
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.783015 6527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.775502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:54985)
0811 18:53:28.775668 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.775712 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.776206 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.776434 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.776439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.777018 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.777216 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.777221 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.778083 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.778085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.779102 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.779105 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.779515 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.779516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.779636 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.780138 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.780148 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.782868 (+ 2720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":102,"threads_started":1}
W20260811 18:53:28.783052 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.775589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:54985 (local address 127.23.226.254:40395)
0811 18:53:28.775646 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.775649 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.775794 (+ 145us) server_negotiation.cc:407] Connection header received
0811 18:53:28.776301 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.776303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.776314 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.776382 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.777336 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.777892 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.779203 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.779414 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.779484 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.782973 (+ 3489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:54985: BlockingRecv error: recv got EOF from 127.23.226.195:54985 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 18:53:28.783311 6522 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:40395 (0 consecutive failures): Not authorized: Failed to ping master at 127.23.226.254:40395: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.788015 6527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.783551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:44377)
0811 18:53:28.783596 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.783606 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.783650 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.783793 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.783793 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.783916 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.783962 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.783963 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.784596 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.784597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.785093 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.785095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.785492 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.785493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.785572 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.785891 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.785896 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.787936 (+ 2040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 18:53:28.788069 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.783584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:44377 (local address 127.23.226.254:40395)
0811 18:53:28.783656 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.783658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.783683 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:53:28.783704 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.783705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.783713 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.783775 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.784039 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.784507 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.785186 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.785416 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.785482 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.788007 (+ 2525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:44377: BlockingRecv error: recv got EOF from 127.23.226.195:44377 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:53:28.789990 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.782446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38722 (local address 127.23.226.254:40395)
0811 18:53:28.782597 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.782600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.782631 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:53:28.782659 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.782660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.782671 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.782751 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.783627 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.784093 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.784848 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.785049 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.785123 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.786685 (+ 1562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:28.786692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:28.786693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:28.786708 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:28.788572 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.788926 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.788930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.788930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.789027 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:28.789253 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:28.789254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:28.789254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:28.789482 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:28.789636 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:28.789758 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 18:53:28.789872 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":75,"threads_started":1}
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:28 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:28.792428 6527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:28.788257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:46801)
0811 18:53:28.788381 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:28.788390 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:28.788459 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:28.788576 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:28.788577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:28.788710 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:28.788734 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.788735 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.789348 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.789349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.789834 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:28.789836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.790224 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.790226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:28.790292 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.790711 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:28.790716 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:28.792381 (+ 1665us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
W20260811 18:53:28.792550 6146 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:28.788294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:46801 (local address 127.23.226.254:40395)
0811 18:53:28.788329 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:28.788330 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:28.788448 (+ 118us) server_negotiation.cc:407] Connection header received
0811 18:53:28.788507 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:28.788508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:28.788517 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:28.788572 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:28.788807 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.789253 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.789921 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:28.790152 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:28.790213 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:28.792480 (+ 2267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:46801: BlockingRecv error: recv got EOF from 127.23.226.195:46801 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 18:53:28.792574 6522 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 18:53:29 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:29 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:29.500844 6534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.495362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:37569)
0811 18:53:29.495607 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.495623 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:29.495783 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:29.496077 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:29.496078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:29.496334 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:29.496433 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.496436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.497170 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.497171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.497734 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.497736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.498118 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.498119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.498237 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.498792 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:29.498802 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:29.500722 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":99,"threads_started":1}
W20260811 18:53:29.500895 6535 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:29.495490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:37569 (local address 127.23.226.254:40395)
0811 18:53:29.495661 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.495664 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.495686 (+ 22us) server_negotiation.cc:407] Connection header received
0811 18:53:29.495936 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.495936 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.495952 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.496033 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.496525 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.497059 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.497828 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.498038 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.498119 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.500820 (+ 2701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:37569: BlockingRecv error: recv got EOF from 127.23.226.193:37569 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
Aug 11 18:53:29 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:29 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:29.644439 6536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.638889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:41771)
0811 18:53:29.639161 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.639179 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:29.639270 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:29.639452 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:29.639453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:29.639683 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:29.639754 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.639757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.640509 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.640510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.641151 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.641154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.641552 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.641553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.641645 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.642161 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:29.642167 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:29.644370 (+ 2203us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":112,"threads_started":1}
W20260811 18:53:29.644659 6535 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:29.639021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:41771 (local address 127.23.226.254:40395)
0811 18:53:29.639113 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.639115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.639249 (+ 134us) server_negotiation.cc:407] Connection header received
0811 18:53:29.639345 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.639346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.639365 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.639439 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.639824 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.640404 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.641266 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.641466 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.641533 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.644561 (+ 3028us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:41771: BlockingRecv error: recv got EOF from 127.23.226.194:41771 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 18:53:29 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:29 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:29.798616 6537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:29.793030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:50417)
0811 18:53:29.793364 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:29.793378 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:29.793482 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:29.793682 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:29.793684 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:29.793903 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:29.793959 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.793961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.794918 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.794920 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.795538 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:29.795540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.795929 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.795930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:29.795989 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.796577 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:29.796589 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:29.798548 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":222,"threads_started":1}
W20260811 18:53:29.798812 6535 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:29.793245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:50417 (local address 127.23.226.254:40395)
0811 18:53:29.793347 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:29.793349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:29.793463 (+ 114us) server_negotiation.cc:407] Connection header received
0811 18:53:29.793544 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:29.793545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:29.793594 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:29.793660 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:29.794045 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.794842 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.795642 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:29.795854 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:29.795929 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:29.798742 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:50417: BlockingRecv error: recv got EOF from 127.23.226.195:50417 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 18:53:30 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:30 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:30.507215 6538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:30.501504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:60857)
0811 18:53:30.501708 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:30.501729 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:30.501786 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:30.502027 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:30.502027 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:30.502223 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:30.502278 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:30.502281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.503040 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.503041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:30.503653 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:30.503655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.504090 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.504091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:30.504161 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.504832 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:30.504837 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:30.507146 (+ 2309us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":138,"threads_started":1}
W20260811 18:53:30.507392 6541 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.501574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:60857 (local address 127.23.226.254:40395)
0811 18:53:30.501875 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.501877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.501892 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:53:30.501920 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.501921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.501934 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.502006 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.502362 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.502945 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.503754 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.503974 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.504046 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.507277 (+ 3231us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:60857: BlockingRecv error: recv got EOF from 127.23.226.193:60857 (error 108)
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":229,"threads_started":1}
Aug 11 18:53:30 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:30 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:30.650285 6542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:30.644940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:41865)
0811 18:53:30.645145 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:30.645160 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:30.645238 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:30.645387 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:30.645388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:30.645580 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:30.645635 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:30.645636 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.646300 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.646302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:30.647078 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:30.647081 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.647499 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.647501 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:30.647612 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.648129 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:30.648135 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:30.650180 (+ 2045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":142,"threads_started":1}
W20260811 18:53:30.650355 6541 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.645026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:41865 (local address 127.23.226.254:40395)
0811 18:53:30.645091 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.645093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.645232 (+ 139us) server_negotiation.cc:407] Connection header received
0811 18:53:30.645295 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.645295 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.645307 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.645367 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.645716 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.646229 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.647156 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.647398 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.647459 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.650292 (+ 2833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:41865: BlockingRecv error: recv got EOF from 127.23.226.194:41865 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 18:53:30 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:30 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:30.804184 6543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:30.799194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:34345)
0811 18:53:30.799365 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:30.799378 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:30.799436 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:30.799588 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:30.799589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:30.799786 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:30.799844 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:30.799846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.800544 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.800545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:30.801119 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:30.801121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.801550 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.801552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:30.801602 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.802102 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:30.802107 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:30.804124 (+ 2017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":69,"threads_started":1}
W20260811 18:53:30.804342 6541 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:30.799338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:34345 (local address 127.23.226.254:40395)
0811 18:53:30.799421 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:30.799423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:30.799433 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:30.799487 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:30.799488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:30.799501 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:30.799555 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:30.799921 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.800468 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.801261 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:30.801462 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:30.801529 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:30.804250 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:34345: BlockingRecv error: recv got EOF from 127.23.226.195:34345 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 18:53:31 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:31 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:31.517129 6544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:31.507731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:59355)
0811 18:53:31.507903 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:31.507916 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:31.507986 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:31.508136 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:31.508138 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:31.508348 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:31.508406 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:31.508408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.509098 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.509100 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:31.509789 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:31.509791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.510218 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.510219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:31.510278 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:31.514532 (+ 4254us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:31.514547 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:31.517068 (+ 2521us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":87,"threads_started":1}
W20260811 18:53:31.517311 6545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:31.507844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:59355 (local address 127.23.226.254:40395)
0811 18:53:31.507964 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:31.507966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:31.507976 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:31.508040 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:31.508041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:31.508052 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:31.508111 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:31.508477 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.509012 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.509883 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.510115 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.510187 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:31.517204 (+ 7017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:59355: BlockingRecv error: recv got EOF from 127.23.226.193:59355 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
Aug 11 18:53:31 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:31 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:31.655805 6546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:31.650868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:34699)
0811 18:53:31.651068 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:31.651081 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:31.651153 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:31.651296 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:31.651297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:31.651496 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:31.651551 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:31.651553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.652260 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.652261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:31.652853 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:31.652854 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.653224 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.653225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:31.653270 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:31.653772 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:31.653777 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:31.655731 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":93,"threads_started":1}
W20260811 18:53:31.655913 6545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:31.650953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:34699 (local address 127.23.226.254:40395)
0811 18:53:31.651063 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:31.651065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:31.651160 (+ 95us) server_negotiation.cc:407] Connection header received
0811 18:53:31.651205 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:31.651206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:31.651219 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:31.651273 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:31.651631 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.652185 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.652933 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.653150 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.653211 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:31.655840 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:34699: BlockingRecv error: recv got EOF from 127.23.226.194:34699 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 18:53:31 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:31 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:31.810206 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:31.804779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:43219)
0811 18:53:31.804965 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:31.804977 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:31.805058 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:31.805294 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:31.805295 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:31.805476 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:31.805529 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:31.805530 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.806348 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.806349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:31.806980 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:31.806983 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.807364 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.807366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:31.807409 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:31.807907 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:31.807912 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:31.810101 (+ 2189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":92,"threads_started":1}
W20260811 18:53:31.810313 6545 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:31.804909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:43219 (local address 127.23.226.254:40395)
0811 18:53:31.804978 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:31.804980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:31.805028 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:53:31.805106 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:31.805107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:31.805123 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:31.805225 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:31.805639 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.806250 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.807082 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:31.807283 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:31.807351 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:31.810243 (+ 2892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:43219: BlockingRecv error: recv got EOF from 127.23.226.195:43219 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 18:53:32 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:32 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:32.523164 6550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:32.517695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:45747)
0811 18:53:32.517965 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:32.517975 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:32.518034 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:32.518213 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:32.518214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:32.518394 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:32.518504 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:32.518507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.519160 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.519160 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:32.519691 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:32.519692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.520147 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.520148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:32.520195 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:32.520701 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:32.520705 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:32.523097 (+ 2392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":206,"threads_started":1}
W20260811 18:53:32.523360 6551 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:32.517784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:45747 (local address 127.23.226.254:40395)
0811 18:53:32.517930 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:32.517932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:32.518035 (+ 103us) server_negotiation.cc:407] Connection header received
0811 18:53:32.518080 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:32.518080 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:32.518091 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:32.518188 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:32.518574 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.519079 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.519792 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.520022 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.520140 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:32.523276 (+ 3136us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:45747: BlockingRecv error: recv got EOF from 127.23.226.193:45747 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
Aug 11 18:53:32 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:32 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:32.661373 6553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:32.656416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:51737)
0811 18:53:32.656548 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:32.656560 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:32.656636 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:32.656787 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:32.656787 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:32.656974 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:32.657028 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:32.657030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.657706 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.657707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:32.658320 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:32.658322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.658806 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.658808 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:32.658861 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:32.659444 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:32.659448 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:32.661312 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":74,"threads_started":1}
W20260811 18:53:32.661536 6551 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:32.656480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:51737 (local address 127.23.226.254:40395)
0811 18:53:32.656555 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:32.656557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:32.656665 (+ 108us) server_negotiation.cc:407] Connection header received
0811 18:53:32.656707 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:32.656708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:32.656722 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:32.656781 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:32.657092 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.657592 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.658469 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.658709 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.658777 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:32.661448 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:51737: BlockingRecv error: recv got EOF from 127.23.226.194:51737 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 18:53:32 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:32 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:32.815462 6554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:32.810760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:60489)
0811 18:53:32.810894 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:32.810906 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:32.810965 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:32.811164 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:32.811164 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:32.811333 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:32.811383 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:32.811385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.812050 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.812051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:32.812579 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:32.812580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.812916 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.812917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:32.812958 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:32.813505 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:32.813511 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:32.815404 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
W20260811 18:53:32.815582 6551 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:32.810831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:60489 (local address 127.23.226.254:40395)
0811 18:53:32.810964 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:32.810966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:32.811017 (+ 51us) server_negotiation.cc:407] Connection header received
0811 18:53:32.811076 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:32.811077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:32.811092 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:32.811139 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:32.811464 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.811969 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.812661 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:32.812847 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:32.812904 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:32.815497 (+ 2593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:60489: BlockingRecv error: recv got EOF from 127.23.226.195:60489 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 18:53:33 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:33 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:33.528600 6555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.523736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:59431)
0811 18:53:33.523920 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.523933 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:33.523997 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:33.524181 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:33.524182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:33.524418 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:33.524479 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:33.524482 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.525223 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.525223 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:33.525745 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:33.525746 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.526100 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.526101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:33.526141 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:33.526676 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:33.526681 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:33.528538 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
W20260811 18:53:33.528786 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:33.523791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:59431 (local address 127.23.226.254:40395)
0811 18:53:33.523964 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:33.523967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:33.523981 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:53:33.524061 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:33.524062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:33.524076 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:33.524155 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:33.524551 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.525141 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.525820 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.526029 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.526091 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:33.528671 (+ 2580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:59431: BlockingRecv error: recv got EOF from 127.23.226.193:59431 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":116,"threads_started":1}
Aug 11 18:53:33 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:33 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:33.666852 6557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.661879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:49249)
0811 18:53:33.662048 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.662061 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:33.662130 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:33.662303 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:33.662304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:33.662523 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:33.662574 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:33.662576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.663308 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.663310 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:33.663853 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:33.663855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.664220 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.664222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:33.664284 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:33.664743 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:33.664748 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:33.666753 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":63,"threads_started":1}
W20260811 18:53:33.666899 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:33.662081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:49249 (local address 127.23.226.254:40395)
0811 18:53:33.662163 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:33.662165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:33.662173 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:53:33.662202 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:33.662203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:33.662223 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:33.662291 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:33.662679 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.663216 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.663942 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.664143 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.664222 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:33.666836 (+ 2614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:49249: BlockingRecv error: recv got EOF from 127.23.226.194:49249 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 18:53:33 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:33 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:33.822602 6558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:33.816040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:51785)
0811 18:53:33.816217 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:33.816230 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:33.816311 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:33.816526 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:33.816527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:33.816722 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:33.816774 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:33.816776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.818004 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.818006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:33.818895 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:33.818898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.819346 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.819347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:33.819431 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:33.820053 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:33.820059 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:33.822473 (+ 2414us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":84,"threads_started":1}
W20260811 18:53:33.822652 6556 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:33.816087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:51785 (local address 127.23.226.254:40395)
0811 18:53:33.816165 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:33.816167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:33.816316 (+ 149us) server_negotiation.cc:407] Connection header received
0811 18:53:33.816381 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:33.816381 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:33.816411 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:33.816480 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:33.816865 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.817883 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.818980 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:33.819277 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:33.819342 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:33.822575 (+ 3233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:51785: BlockingRecv error: recv got EOF from 127.23.226.195:51785 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 18:53:34 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:34 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:34.534528 6559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.529236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:36257)
0811 18:53:34.529378 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.529389 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.529449 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.529666 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.529667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.529908 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.529958 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.529960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.530857 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.530858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.531398 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.531399 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.531794 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.531795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.531856 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.532344 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.532348 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.534451 (+ 2103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
W20260811 18:53:34.534682 6560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:34.529328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:36257 (local address 127.23.226.254:40395)
0811 18:53:34.529485 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.529486 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.529495 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:34.529519 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.529519 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.529530 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.529625 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.530035 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.530789 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.531479 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.531692 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.531766 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.534583 (+ 2817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:36257: BlockingRecv error: recv got EOF from 127.23.226.193:36257 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
Aug 11 18:53:34 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:34 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:34.672554 6561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.667385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:38943)
0811 18:53:34.667542 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.667557 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.667619 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.667770 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.667771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.667955 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.668021 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.668023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.668701 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.668702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.669229 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.669231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.669583 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.669584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.669645 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.670164 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.670169 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.672451 (+ 2282us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
W20260811 18:53:34.672601 6560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:34.667467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:38943 (local address 127.23.226.254:40395)
0811 18:53:34.667544 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.667546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.667613 (+ 67us) server_negotiation.cc:407] Connection header received
0811 18:53:34.667672 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.667673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.667686 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.667746 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.668104 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.668617 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.669312 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.669500 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.669571 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.672538 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:38943: BlockingRecv error: recv got EOF from 127.23.226.194:38943 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 11 18:53:34 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:34 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:34.828671 6562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:34.823346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:39797)
0811 18:53:34.823515 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:34.823530 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:34.823652 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:34.823869 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:34.823870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:34.824101 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:34.824176 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.824180 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.824962 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.824963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.825531 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:34.825533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.825960 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.825961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:34.826006 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.826563 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:34.826569 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:34.828609 (+ 2040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
W20260811 18:53:34.828853 6560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:34.823398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:39797 (local address 127.23.226.254:40395)
0811 18:53:34.823463 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:34.823466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:34.823645 (+ 179us) server_negotiation.cc:407] Connection header received
0811 18:53:34.823764 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:34.823765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:34.823782 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:34.823850 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:34.824291 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.824860 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.825646 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:34.825876 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:34.825949 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:34.828763 (+ 2814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:39797: BlockingRecv error: recv got EOF from 127.23.226.195:39797 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 18:53:35 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:35 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:35.540318 6563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:35.534983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:41035)
0811 18:53:35.535122 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:35.535134 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:35.535183 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:35.535395 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:35.535396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:35.535577 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:35.535639 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:35.535641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.536400 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.536401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:35.536952 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:35.536954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.537341 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.537342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:35.537417 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:35.537977 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:35.537982 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:35.540256 (+ 2274us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
W20260811 18:53:35.540484 6564 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.535114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:41035 (local address 127.23.226.254:40395)
0811 18:53:35.535261 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.535263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.535272 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:53:35.535296 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.535297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.535308 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.535379 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.535757 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.536313 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.537060 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.537267 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.537331 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:35.540391 (+ 3060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:41035: BlockingRecv error: recv got EOF from 127.23.226.193:41035 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":83,"threads_started":1}
Aug 11 18:53:35 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:35 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:35.678066 6568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:35.673088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:58961)
0811 18:53:35.673345 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:35.673358 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:35.673433 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:35.673573 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:35.673574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:35.673763 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:35.673816 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:35.673818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.674520 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.674521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:35.675146 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:35.675149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.675580 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.675581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:35.675640 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:35.676111 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:35.676117 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:35.678006 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":166,"threads_started":1}
W20260811 18:53:35.678260 6564 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.673197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:58961 (local address 127.23.226.254:40395)
0811 18:53:35.673282 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.673284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.673430 (+ 146us) server_negotiation.cc:407] Connection header received
0811 18:53:35.673496 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.673496 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.673508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.673551 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.673884 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.674374 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.675281 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.675486 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.675553 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:35.678183 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:58961: BlockingRecv error: recv got EOF from 127.23.226.194:58961 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 18:53:35 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:35 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:35.834724 6570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:35.829242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:38269)
0811 18:53:35.829410 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:35.829420 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:35.829488 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:35.829690 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:35.829692 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:35.829894 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:35.829958 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:35.829960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.830800 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.830801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:35.831361 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:35.831363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.831764 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.831765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:35.831813 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:35.832461 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:35.832467 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:35.834615 (+ 2148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
W20260811 18:53:35.834765 6564 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:35.829320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:38269 (local address 127.23.226.254:40395)
0811 18:53:35.829406 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:35.829408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:35.829531 (+ 123us) server_negotiation.cc:407] Connection header received
0811 18:53:35.829558 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:35.829559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:35.829574 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:35.829623 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:35.830104 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.830701 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.831457 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:35.831682 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:35.831749 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:35.834702 (+ 2953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:38269: BlockingRecv error: recv got EOF from 127.23.226.195:38269 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 18:53:36 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:36 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:36.549429 6571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:36.540806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:54607)
0811 18:53:36.540947 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:36.540958 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:36.541008 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:36.541249 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:36.541250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:36.541427 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:36.541483 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:36.541484 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.542209 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.542210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:36.542808 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:36.542810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.543224 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.543225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:36.543269 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.547163 (+ 3894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:36.547168 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:36.549344 (+ 2176us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
W20260811 18:53:36.549674 6573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:36.540959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:54607 (local address 127.23.226.254:40395)
0811 18:53:36.541108 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.541110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.541118 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:53:36.541149 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.541150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.541161 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.541224 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:36.541585 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.542128 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.542893 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.543124 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.543185 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.549597 (+ 6412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:54607: BlockingRecv error: recv got EOF from 127.23.226.193:54607 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
Aug 11 18:53:36 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:36 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:36.684432 6574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:36.678726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:33845)
0811 18:53:36.678945 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:36.678959 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:36.679032 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:36.679210 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:36.679211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:36.679402 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:36.679457 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:36.679459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.680278 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.680279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:36.680872 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:36.680874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.681283 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.681284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:36.681342 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.681961 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:36.681967 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:36.684372 (+ 2405us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":126,"threads_started":1}
W20260811 18:53:36.684628 6573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:36.678796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:33845 (local address 127.23.226.254:40395)
0811 18:53:36.678874 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.678876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.679034 (+ 158us) server_negotiation.cc:407] Connection header received
0811 18:53:36.679085 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.679086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.679100 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.679155 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:36.679529 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.680186 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.680955 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.681173 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.681233 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.684511 (+ 3278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:33845: BlockingRecv error: recv got EOF from 127.23.226.194:33845 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 18:53:36 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:36 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:36.840795 6575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:36.835317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:49679)
0811 18:53:36.835570 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:36.835585 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:36.835700 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:36.835884 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:36.835885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:36.836086 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:36.836138 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:36.836140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.836852 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.836854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:36.837540 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:36.837543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.838035 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.838036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:36.838101 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.838715 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:36.838721 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:36.840689 (+ 1968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":133,"threads_started":1}
W20260811 18:53:36.840852 6573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:36.835493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:49679 (local address 127.23.226.254:40395)
0811 18:53:36.835580 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:36.835583 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:36.835676 (+ 93us) server_negotiation.cc:407] Connection header received
0811 18:53:36.835776 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:36.835777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:36.835793 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:36.835872 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:36.836233 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.836747 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.837630 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:36.837957 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:36.838034 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:36.840784 (+ 2750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:49679: BlockingRecv error: recv got EOF from 127.23.226.195:49679 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 18:53:37 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:37 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:37.555346 6576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:37.549936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:52371)
0811 18:53:37.550155 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:37.550168 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:37.550232 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:37.550509 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:37.550510 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:37.550729 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:37.550781 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:37.550783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.551493 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.551494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:37.552035 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:37.552036 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.552429 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.552430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:37.552492 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:37.553049 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:37.553055 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:37.555284 (+ 2229us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":77,"threads_started":1}
W20260811 18:53:37.555512 6577 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:37.550013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:52371 (local address 127.23.226.254:40395)
0811 18:53:37.550313 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:37.550315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:37.550325 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:37.550356 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:37.550357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:37.550385 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:37.550491 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:37.550870 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.551402 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.552132 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.552350 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.552431 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:37.555405 (+ 2974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:52371: BlockingRecv error: recv got EOF from 127.23.226.193:52371 (error 108)
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":78,"threads_started":1}
Aug 11 18:53:37 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:37 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:37.690356 6578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:37.685034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:46875)
0811 18:53:37.685245 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:37.685256 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:37.685320 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:37.685476 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:37.685477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:37.685670 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:37.685723 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:37.685725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.686517 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.686519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:37.687116 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:37.687118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.687568 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.687569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:37.687622 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:37.688169 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:37.688174 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:37.690290 (+ 2116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
W20260811 18:53:37.690495 6577 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:37.685110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:46875 (local address 127.23.226.254:40395)
0811 18:53:37.685217 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:37.685219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:37.685364 (+ 145us) server_negotiation.cc:407] Connection header received
0811 18:53:37.685392 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:37.685393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:37.685409 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:37.685455 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:37.685795 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.686396 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.687208 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.687453 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.687533 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:37.690386 (+ 2853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:46875: BlockingRecv error: recv got EOF from 127.23.226.194:46875 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 18:53:37 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:37 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:37.846544 6579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:37.841332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:46859)
0811 18:53:37.841480 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:37.841495 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:37.841558 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:37.841768 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:37.841769 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:37.841952 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:37.842008 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:37.842010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.842751 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.842752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:37.843326 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:37.843328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.843742 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.843743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:37.843803 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:37.844288 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:37.844293 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:37.846403 (+ 2110us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
W20260811 18:53:37.846616 6577 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:37.841447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:46859 (local address 127.23.226.254:40395)
0811 18:53:37.841509 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:37.841511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:37.841542 (+ 31us) server_negotiation.cc:407] Connection header received
0811 18:53:37.841647 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:37.841648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:37.841663 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:37.841726 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:37.842146 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.842676 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.843430 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:37.843645 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:37.843720 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:37.846531 (+ 2811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:46859: BlockingRecv error: recv got EOF from 127.23.226.195:46859 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 18:53:38 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:38 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:38.561108 6580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:38.555938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:39463)
0811 18:53:38.556098 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:38.556109 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:38.556173 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:38.556348 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:38.556349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:38.556529 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:38.556601 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:38.556603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.557375 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.557376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:38.557908 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:38.557909 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.558354 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.558355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:38.558401 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:38.558993 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:38.558998 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:38.561005 (+ 2007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
W20260811 18:53:38.561210 6581 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:38.556073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:39463 (local address 127.23.226.254:40395)
0811 18:53:38.556209 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:38.556211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:38.556221 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:38.556267 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:38.556268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:38.556279 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:38.556333 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:38.556690 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.557285 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.558008 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.558271 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.558335 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:38.561087 (+ 2752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:39463: BlockingRecv error: recv got EOF from 127.23.226.193:39463 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":64,"threads_started":1}
Aug 11 18:53:38 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:38 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:38.696049 6583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:38.690977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:47847)
0811 18:53:38.691129 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:38.691148 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:38.691203 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:38.691351 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:38.691352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:38.691527 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:38.691580 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:38.691581 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.692559 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.692560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:38.693091 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:38.693093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.693444 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.693445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:38.693486 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:38.693940 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:38.693945 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:38.695948 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
W20260811 18:53:38.696105 6581 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:38.691067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:47847 (local address 127.23.226.254:40395)
0811 18:53:38.691184 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:38.691186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:38.691197 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:38.691257 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:38.691258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:38.691269 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:38.691332 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:38.691651 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.692476 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.693178 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.693369 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.693427 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:38.696040 (+ 2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:47847: BlockingRecv error: recv got EOF from 127.23.226.194:47847 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 18:53:38 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:38 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:38.852152 6586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:38.847027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:49843)
0811 18:53:38.847249 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:38.847270 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:38.847380 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:38.847555 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:38.847556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:38.847855 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:38.847911 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:38.847913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.848672 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.848673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:38.849230 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:38.849232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.849591 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.849592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:38.849634 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:38.850112 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:38.850117 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:38.852090 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":125,"threads_started":1}
W20260811 18:53:38.852300 6581 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:38.847194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:49843 (local address 127.23.226.254:40395)
0811 18:53:38.847244 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:38.847246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:38.847435 (+ 189us) server_negotiation.cc:407] Connection header received
0811 18:53:38.847463 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:38.847464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:38.847481 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:38.847528 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:38.847984 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.848565 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.849328 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:38.849517 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:38.849578 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:38.852201 (+ 2623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:49843: BlockingRecv error: recv got EOF from 127.23.226.195:49843 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 18:53:39 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:39 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:39.567204 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:39.561769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:51187)
0811 18:53:39.561962 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:39.561979 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:39.562061 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:39.562212 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:39.562213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:39.562477 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:39.562566 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:39.562569 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.563407 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.563409 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:39.563951 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:39.563953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.564456 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.564457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:39.564532 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:39.565165 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:39.565171 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:39.567142 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":85,"threads_started":1}
W20260811 18:53:39.567348 6588 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:39.561887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:51187 (local address 127.23.226.254:40395)
0811 18:53:39.562062 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:39.562065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:39.562081 (+ 16us) server_negotiation.cc:407] Connection header received
0811 18:53:39.562106 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:39.562107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:39.562120 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:39.562188 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:39.562722 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.563308 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.564094 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.564351 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.564438 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:39.567251 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:51187: BlockingRecv error: recv got EOF from 127.23.226.193:51187 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":84,"threads_started":1}
Aug 11 18:53:39 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:39 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:39.701452 6589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:39.696645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:35421)
0811 18:53:39.696819 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:39.696831 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:39.696903 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:39.697090 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:39.697091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:39.697274 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:39.697326 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:39.697328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.697985 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.697986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:39.698605 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:39.698608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.698983 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.698984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:39.699037 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:39.699524 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:39.699529 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:39.701377 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":118,"threads_started":1}
W20260811 18:53:39.701611 6588 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:39.696691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:35421 (local address 127.23.226.254:40395)
0811 18:53:39.696774 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:39.696776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:39.696904 (+ 128us) server_negotiation.cc:407] Connection header received
0811 18:53:39.696969 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:39.696970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:39.696981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:39.697024 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:39.697395 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.697901 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.698686 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.698883 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.698942 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:39.701529 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:35421: BlockingRecv error: recv got EOF from 127.23.226.194:35421 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 18:53:39 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:39 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:39.857904 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:39.852683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:41351)
0811 18:53:39.852837 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:39.852851 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:39.852924 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:39.853099 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:39.853101 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:39.853305 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:39.853353 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:39.853355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.854041 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.854043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:39.854669 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:39.854671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.855109 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.855110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:39.855179 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:39.855690 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:39.855695 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:39.857786 (+ 2091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
W20260811 18:53:39.857940 6588 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:39.852800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:41351 (local address 127.23.226.254:40395)
0811 18:53:39.852860 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:39.852862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:39.852902 (+ 40us) server_negotiation.cc:407] Connection header received
0811 18:53:39.852987 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:39.852988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:39.853005 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:39.853076 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:39.853438 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.853952 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.854756 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:39.854949 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:39.855107 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:39.857873 (+ 2766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:41351: BlockingRecv error: recv got EOF from 127.23.226.195:41351 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 11 18:53:40 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:40 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:40.572788 6591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:40.567745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:53297)
0811 18:53:40.567954 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:40.567967 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:40.568045 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:40.568203 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:40.568204 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:40.568403 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:40.568454 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:40.568457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.569145 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.569146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:40.569774 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:40.569776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.570152 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.570153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:40.570205 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:40.570701 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:40.570707 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:40.572728 (+ 2021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":145,"threads_started":1}
W20260811 18:53:40.572984 6593 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:40.567828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:53297 (local address 127.23.226.254:40395)
0811 18:53:40.567963 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:40.567965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:40.568042 (+ 77us) server_negotiation.cc:407] Connection header received
0811 18:53:40.568096 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:40.568096 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:40.568108 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:40.568173 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:40.568535 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.569057 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.569871 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.570071 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.570128 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:40.572889 (+ 2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:53297: BlockingRecv error: recv got EOF from 127.23.226.193:53297 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":79,"threads_started":1}
Aug 11 18:53:40 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:40 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 18:53:40.707191 6593 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:40.702139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:34085 (local address 127.23.226.254:40395)
0811 18:53:40.702229 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:40.702231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:40.702241 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:40.702287 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:40.702288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:40.702300 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:40.702361 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:40.702713 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.703275 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.704057 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.704264 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.704334 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:40.707128 (+ 2794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:34085: BlockingRecv error: recv got EOF from 127.23.226.194:34085 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:53:40.707193 6594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:40.701981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:34085)
0811 18:53:40.702157 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:40.702176 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:40.702236 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:40.702374 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:40.702374 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:40.702585 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:40.702638 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:40.702641 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.703378 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.703380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:40.703948 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:40.703950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.704355 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.704357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:40.704409 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:40.704914 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:40.704919 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:40.707036 (+ 2117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":108,"threads_started":1}
Aug 11 18:53:40 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:40 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:40.863806 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:40.858628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:45339)
0811 18:53:40.858805 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:40.858819 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:40.858912 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:40.859098 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:40.859100 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:40.859337 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:40.859389 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:40.859391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.860082 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.860083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:40.860643 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:40.860645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.861032 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.861033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:40.861098 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:40.861614 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:40.861619 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:40.863733 (+ 2114us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":76,"threads_started":1}
W20260811 18:53:40.864001 6593 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:40.858707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:45339 (local address 127.23.226.254:40395)
0811 18:53:40.858794 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:40.858797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:40.858892 (+ 95us) server_negotiation.cc:407] Connection header received
0811 18:53:40.858990 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:40.858991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:40.859008 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:40.859075 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:40.859478 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.859993 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.860745 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:40.860946 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:40.861020 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:40.863917 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:45339: BlockingRecv error: recv got EOF from 127.23.226.195:45339 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 18:53:41 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:41 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:41.584220 6598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:41.573381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:44565)
0811 18:53:41.573537 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:41.573550 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:41.573632 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:41.573816 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:41.573817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:41.574033 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:41.574094 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:41.574096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.574901 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.574903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:41.575500 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:41.575501 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.575876 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.575877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:41.575926 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:41.581806 (+ 5880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:41.581814 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:41.584099 (+ 2285us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
W20260811 18:53:41.584381 6599 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:41.573433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:44565 (local address 127.23.226.254:40395)
0811 18:53:41.573575 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:41.573577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:41.573617 (+ 40us) server_negotiation.cc:407] Connection header received
0811 18:53:41.573708 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:41.573708 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:41.573725 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:41.573805 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:41.574204 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.574809 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.575593 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.575800 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.575857 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:41.584299 (+ 8442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:44565: BlockingRecv error: recv got EOF from 127.23.226.193:44565 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
Aug 11 18:53:41 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:41 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:41.712648 6600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:41.707756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:54299)
0811 18:53:41.707958 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:41.707971 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:41.708060 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:41.708277 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:41.708278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:41.708458 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:41.708511 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:41.708512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.709245 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.709247 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:41.709790 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:41.709792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.710154 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.710155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:41.710214 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:41.710711 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:41.710716 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:41.712553 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":103,"threads_started":1}
W20260811 18:53:41.712720 6599 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:41.707934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:54299 (local address 127.23.226.254:40395)
0811 18:53:41.708007 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:41.708009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:41.708020 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:41.708153 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:41.708154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:41.708186 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:41.708257 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:41.708599 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.709136 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.709879 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.710076 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.710155 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:41.712656 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:54299: BlockingRecv error: recv got EOF from 127.23.226.194:54299 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 18:53:41 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:41 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:41.869359 6602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:41.864418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:56817)
0811 18:53:41.864594 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:41.864609 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:41.864680 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:41.864805 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:41.864806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:41.864994 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:41.865057 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:41.865058 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.865763 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.865764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:41.866314 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:41.866315 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.866810 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.866811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:41.866858 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:41.867432 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:41.867437 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:41.869296 (+ 1859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":118,"threads_started":1}
W20260811 18:53:41.869477 6599 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:41.864487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:56817 (local address 127.23.226.254:40395)
0811 18:53:41.864566 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:41.864568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:41.864686 (+ 118us) server_negotiation.cc:407] Connection header received
0811 18:53:41.864739 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:41.864740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:41.864756 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:41.864798 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:41.865127 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.865672 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.866435 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:41.866683 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:41.866756 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:41.869398 (+ 2642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:56817: BlockingRecv error: recv got EOF from 127.23.226.195:56817 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 18:53:42 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:42 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:42.589993 6604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:42.584885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:45709)
0811 18:53:42.585064 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:42.585075 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:42.585136 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:42.585324 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:42.585325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:42.585510 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:42.585565 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:42.585567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.586408 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.586409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:42.587068 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:42.587071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.587447 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.587448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:42.587492 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:42.588019 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:42.588024 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:42.589896 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":107,"threads_started":1}
W20260811 18:53:42.590157 6607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:42.584995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:45709 (local address 127.23.226.254:40395)
0811 18:53:42.585155 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:42.585157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:42.585167 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:42.585203 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:42.585204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:42.585216 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:42.585283 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:42.585671 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.586305 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.587151 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.587376 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.587438 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:42.590069 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:45709: BlockingRecv error: recv got EOF from 127.23.226.193:45709 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":99,"threads_started":1}
Aug 11 18:53:42 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:42 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:42.718576 6608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:42.713165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:54439)
0811 18:53:42.713393 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:42.713405 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:42.713489 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:42.713676 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:42.713677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:42.713872 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:42.713921 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:42.713923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.714754 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.714756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:42.715322 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:42.715324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.715715 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.715717 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:42.715784 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:42.716248 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:42.716253 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:42.718412 (+ 2159us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":113,"threads_started":1}
W20260811 18:53:42.718617 6607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:42.713270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:54439 (local address 127.23.226.254:40395)
0811 18:53:42.713370 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:42.713373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:42.713477 (+ 104us) server_negotiation.cc:407] Connection header received
0811 18:53:42.713559 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:42.713560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:42.713581 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:42.713654 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:42.714013 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.714667 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.715424 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.715629 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.715702 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:42.718542 (+ 2840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:54439: BlockingRecv error: recv got EOF from 127.23.226.194:54439 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 18:53:42 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:42 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.195@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:42.875124 6609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:42.869913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.195:43629)
0811 18:53:42.870112 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:42.870129 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:42.870200 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:42.870342 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:42.870343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:42.870559 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:42.870613 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:42.870615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.871335 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.871336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:42.871927 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:42.871928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.872348 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.872349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:42.872410 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:42.873016 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:42.873022 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:42.875059 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":131,"threads_started":1}
W20260811 18:53:42.875308 6607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:42.870050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:43629 (local address 127.23.226.254:40395)
0811 18:53:42.870122 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:42.870124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:42.870198 (+ 74us) server_negotiation.cc:407] Connection header received
0811 18:53:42.870255 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:42.870256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:42.870269 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:42.870326 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:42.870716 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.871246 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.872016 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:42.872239 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:42.872301 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:42.875240 (+ 2939us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.195:43629: BlockingRecv error: recv got EOF from 127.23.226.195:43629 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 18:53:43 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:43 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.193@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:43.596277 6610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:43.590813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.193:45349)
0811 18:53:43.590997 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:43.591013 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:43.591092 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:43.591278 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:43.591279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:43.591453 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:43.591507 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:43.591508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:43.592273 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:43.592274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:43.592827 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:43.592829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:43.593237 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:43.593238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:43.593278 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:43.593981 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:43.593988 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:43.596216 (+ 2228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":78,"threads_started":1}
W20260811 18:53:43.596457 6611 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:43.590930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:45349 (local address 127.23.226.254:40395)
0811 18:53:43.591079 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:43.591081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:43.591091 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:43.591154 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:43.591155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:43.591166 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:43.591228 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:43.591608 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:43.592178 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:43.592931 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:43.593148 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:43.593218 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:43.596340 (+ 3122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.193:45349: BlockingRecv error: recv got EOF from 127.23.226.193:45349 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
Aug 11 18:53:43 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 18:53:43 dist-test-slave-68xk krb5kdc[5121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.23.226.194@KRBTEST.COM for oryx/127.23.226.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 18:53:43.724433 6612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:43.719316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40395 (local address 127.23.226.194:33077)
0811 18:53:43.719576 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:43.719593 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:43.719698 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:43.719879 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:43.719880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:43.720103 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:43.720156 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:43.720159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:43.720859 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:43.720861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:43.721401 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:43.721403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:43.721791 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:43.721792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:43.721853 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:43.722373 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:43.722379 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:43.724333 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.23.226.254:40395: Server oryx/127.23.226.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":135,"threads_started":1}
W20260811 18:53:43.724496 6611 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:43.719418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:33077 (local address 127.23.226.254:40395)
0811 18:53:43.719546 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:43.719550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:43.719676 (+ 126us) server_negotiation.cc:407] Connection header received
0811 18:53:43.719781 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:43.719782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:43.719801 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:43.719868 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:43.720252 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:43.720762 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:43.721497 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:43.721702 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:43.721781 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:43.724429 (+ 2648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.23.226.194:33077: BlockingRecv error: recv got EOF from 127.23.226.194:33077 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 18:53:43.791850 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 5936
I20260811 18:53:43.808104 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 6147
I20260811 18:53:43.820607 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 6339
I20260811 18:53:43.827042 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 5839
2026-08-11T18:53:43Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17994 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T18:53:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:43Z Disabled control of system clock
I20260811 18:53:43.870498 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:33115
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:39157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:33115
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 18:53:43.978494 6618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:43.978714 6618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:43.978735 6618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:43.979863 6618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:43.979902 6618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:43.979915 6618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:43.979928 6618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:43.979941 6618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:43.981230 6618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:33115
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:33115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:43.981432 6618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:43.981693 6618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:53:43.987448 6618 server_base.cc:1034] running on GCE node
W20260811 18:53:43.987493 6627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:43.987511 6629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:43.987516 6631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:43.988018 6618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:43.988345 6618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:43.989535 6618 hybrid_clock.cc:648] HybridClock initialized: now 1786474423989521 us; error 32 us; skew 500 ppm
I20260811 18:53:43.990942 6618 webserver.cc:460] Webserver started at http://127.23.226.254:38865/ using document root <none> and password file <none>
I20260811 18:53:43.991257 6618 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:43.991310 6618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:43.991478 6618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:43.992643 6618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "87ad91c1320e42b18fd45bcfa030c8fa"
format_stamp: "Formatted at 2026-08-11 18:53:43 on dist-test-slave-68xk"
server_key: "8a52a083a4540c10993be9ad1176cc99"
server_key_iv: "92666b3c3f2e102a4d674082a3e7b73b"
server_key_version: "encryptionkey@0"
I20260811 18:53:43.993013 6618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "87ad91c1320e42b18fd45bcfa030c8fa"
format_stamp: "Formatted at 2026-08-11 18:53:43 on dist-test-slave-68xk"
server_key: "8a52a083a4540c10993be9ad1176cc99"
server_key_iv: "92666b3c3f2e102a4d674082a3e7b73b"
server_key_version: "encryptionkey@0"
I20260811 18:53:43.994474 6618 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:43.995368 6638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:43.995545 6618 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:43.995653 6618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "87ad91c1320e42b18fd45bcfa030c8fa"
format_stamp: "Formatted at 2026-08-11 18:53:43 on dist-test-slave-68xk"
server_key: "8a52a083a4540c10993be9ad1176cc99"
server_key_iv: "92666b3c3f2e102a4d674082a3e7b73b"
server_key_version: "encryptionkey@0"
I20260811 18:53:43.995744 6618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:44.004164 6618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:44.004716 6618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:44.004905 6618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:44.009482 6618 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:33115
I20260811 18:53:44.009531 6711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:33115 every 8 connection(s)
I20260811 18:53:44.009896 6618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:44.010671 6712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:44.013310 6712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa: Bootstrap starting.
I20260811 18:53:44.013893 6712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:44.014143 6712 log.cc:824] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:44.014930 6712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa: No bootstrap required, opened a new log
I20260811 18:53:44.016521 6712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ad91c1320e42b18fd45bcfa030c8fa" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33115 } }
I20260811 18:53:44.016686 6712 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:44.016711 6712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ad91c1320e42b18fd45bcfa030c8fa, State: Initialized, Role: FOLLOWER
I20260811 18:53:44.016861 6712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ad91c1320e42b18fd45bcfa030c8fa" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33115 } }
I20260811 18:53:44.016953 6712 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:44.016978 6712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:44.017005 6712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:44.017247 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 6618
I20260811 18:53:44.017347 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:44.017536 24459 external_mini_cluster.cc:1428] Setting key a0788aa98e7e263ab311c3873b5ce6b3
I20260811 18:53:44.017823 6712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ad91c1320e42b18fd45bcfa030c8fa" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33115 } }
I20260811 18:53:44.017943 6712 leader_election.cc:302] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87ad91c1320e42b18fd45bcfa030c8fa; no voters:
I20260811 18:53:44.018148 6712 leader_election.cc:288] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:44.018218 6716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:44.018458 6716 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [term 1 LEADER]: Becoming Leader. State: Replica: 87ad91c1320e42b18fd45bcfa030c8fa, State: Running, Role: LEADER
I20260811 18:53:44.018581 6716 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ad91c1320e42b18fd45bcfa030c8fa" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33115 } }
I20260811 18:53:44.018610 6712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:44.019093 6721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87ad91c1320e42b18fd45bcfa030c8fa. Latest consensus state: current_term: 1 leader_uuid: "87ad91c1320e42b18fd45bcfa030c8fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ad91c1320e42b18fd45bcfa030c8fa" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33115 } } }
I20260811 18:53:44.019217 6719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87ad91c1320e42b18fd45bcfa030c8fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ad91c1320e42b18fd45bcfa030c8fa" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33115 } } }
I20260811 18:53:44.019286 6721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:44.019351 6719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:44.019573 6731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:44.020148 6731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:44.023007 6731 catalog_manager.cc:1347] Generated new cluster ID: 7133ea0740294e8183cc8b1c470cd5be
I20260811 18:53:44.023062 6731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:44.024017 6717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.018049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47804 (local address 127.23.226.254:33115)
0811 18:53:44.018312 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.018321 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.018358 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:53:44.018502 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.018510 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.018587 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.018738 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.018989 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.020640 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.021787 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.022407 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.022576 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.023352 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.023356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.023356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:44.023538 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.023579 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:44.023591 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.023675 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.023742 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.023836 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":82,"threads_started":1}
I20260811 18:53:44.033720 6731 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:44.034528 6731 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:44.040346 6731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87ad91c1320e42b18fd45bcfa030c8fa: Generated new TSK 0
I20260811 18:53:44.040555 6731 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:44.044629 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33115
--builtin_ntp_servers=127.23.226.212:39157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 18:53:44.136878 6748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:44.137142 6748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:44.137181 6748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:44.138476 6748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:44.138548 6748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:44.138600 6748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:44.140060 6748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:44.140364 6748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:44.140705 6748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:44.146875 6753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.146888 6757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.146889 6755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:44.147373 6748 server_base.cc:1034] running on GCE node
I20260811 18:53:44.147603 6748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:44.147897 6748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:44.149081 6748 hybrid_clock.cc:648] HybridClock initialized: now 1786474424149068 us; error 34 us; skew 500 ppm
I20260811 18:53:44.150575 6748 webserver.cc:460] Webserver started at http://127.23.226.193:39695/ using document root <none> and password file <none>
I20260811 18:53:44.150856 6748 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:44.150911 6748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:44.151041 6748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:44.152449 6748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "f8de398b0ee64058a27b15a962abdba7"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "7aa02e3ba5ec7be92e3a5b548969e192"
server_key_iv: "5c4f0361cc4bba4eb852933e4eacd779"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.152849 6748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "f8de398b0ee64058a27b15a962abdba7"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "7aa02e3ba5ec7be92e3a5b548969e192"
server_key_iv: "5c4f0361cc4bba4eb852933e4eacd779"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.154520 6748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 18:53:44.155511 6765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.155707 6748 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:44.155804 6748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "f8de398b0ee64058a27b15a962abdba7"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "7aa02e3ba5ec7be92e3a5b548969e192"
server_key_iv: "5c4f0361cc4bba4eb852933e4eacd779"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.155879 6748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:44.183697 6748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:44.184011 6748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:44.184162 6748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:44.184368 6748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:44.184751 6748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:44.184788 6748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.184813 6748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:44.184825 6748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.191529 6748 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:42497
I20260811 18:53:44.191622 6921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:42497 every 8 connection(s)
I20260811 18:53:44.191969 6748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:44.194226 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 6748
I20260811 18:53:44.194304 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:44.194555 24459 external_mini_cluster.cc:1428] Setting key 508a04118fc651c30410717ea343cbb8
I20260811 18:53:44.195796 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33115
--builtin_ntp_servers=127.23.226.212:39157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 18:53:44.199544 6717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.192879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:59827 (local address 127.23.226.254:33115)
0811 18:53:44.192957 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.192959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.193265 (+ 306us) server_negotiation.cc:407] Connection header received
0811 18:53:44.193816 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.193818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.193832 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.193902 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.195181 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.195939 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.197614 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.198034 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.198128 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.199211 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.199212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.199212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:44.199217 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.199232 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:44.199237 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.199294 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.199432 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.199477 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:53:44.199831 6925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.192856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33115 (local address 127.23.226.193:59827)
0811 18:53:44.193109 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:44.193177 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:44.193700 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:44.194009 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:44.194013 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:44.194023 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:44.194861 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:44.194869 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.196075 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.196077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:44.197457 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:44.197463 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.198144 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.198145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:44.198271 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.199002 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:44.199003 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:44.199035 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:44.199100 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:44.199316 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:44.199322 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:44.199326 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:44.199420 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 18:53:44.199554 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":117,"threads_started":1}
I20260811 18:53:44.200431 6923 heartbeater.cc:347] Connected to a master server at 127.23.226.254:33115
I20260811 18:53:44.200551 6923 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:44.200790 6923 heartbeater.cc:511] Master 127.23.226.254:33115 requested a full tablet report, sending...
I20260811 18:53:44.201392 6663 ts_manager.cc:194] Registered new tserver with Master: f8de398b0ee64058a27b15a962abdba7 (127.23.226.193:42497)
I20260811 18:53:44.202026 6663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.193:59827
W20260811 18:53:44.283461 6926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:44.283669 6926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:44.283689 6926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:44.284853 6926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:44.284896 6926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:44.284921 6926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:44.286267 6926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:44.286558 6926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:44.286878 6926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:44.292033 6938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.292033 6935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.292075 6936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:44.292426 6926 server_base.cc:1034] running on GCE node
I20260811 18:53:44.292647 6926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:44.292902 6926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:44.294047 6926 hybrid_clock.cc:648] HybridClock initialized: now 1786474424294027 us; error 40 us; skew 500 ppm
I20260811 18:53:44.295549 6926 webserver.cc:460] Webserver started at http://127.23.226.194:39983/ using document root <none> and password file <none>
I20260811 18:53:44.295807 6926 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:44.295855 6926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:44.295949 6926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:44.296994 6926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "03edf319536c4e409ec56d735063fa0f"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "fbff8b5d4b0c7d12197dbb125dbf88b6"
server_key_iv: "e71a19e0593ad63879cc8b120d9c6cfe"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.297317 6926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "03edf319536c4e409ec56d735063fa0f"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "fbff8b5d4b0c7d12197dbb125dbf88b6"
server_key_iv: "e71a19e0593ad63879cc8b120d9c6cfe"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.298676 6926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:44.299448 6944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.299690 6926 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:53:44.299796 6926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "03edf319536c4e409ec56d735063fa0f"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "fbff8b5d4b0c7d12197dbb125dbf88b6"
server_key_iv: "e71a19e0593ad63879cc8b120d9c6cfe"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.299875 6926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:44.322054 6926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:44.322485 6926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:44.322607 6926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:44.322914 6926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:44.323275 6926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:44.323310 6926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.323333 6926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:44.323346 6926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.329829 6926 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:43997
I20260811 18:53:44.329875 7090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:43997 every 8 connection(s)
I20260811 18:53:44.330271 6926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:44.333596 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 6926
I20260811 18:53:44.333807 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:44.334000 24459 external_mini_cluster.cc:1428] Setting key d1d5a17761265738335791387795a29c
I20260811 18:53:44.335234 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33115
--builtin_ntp_servers=127.23.226.212:39157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 18:53:44.336429 6717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.331209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:50303 (local address 127.23.226.254:33115)
0811 18:53:44.331294 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.331296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.331523 (+ 227us) server_negotiation.cc:407] Connection header received
0811 18:53:44.332037 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.332038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.332048 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.332125 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.332790 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.333282 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.334811 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.335047 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.335106 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.336147 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.336149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.336149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:44.336153 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.336168 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:44.336173 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.336217 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.336344 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.336370 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:53:44.336772 7095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.331124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33115 (local address 127.23.226.194:50303)
0811 18:53:44.331389 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:44.331432 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:44.331944 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:44.332175 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:44.332178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:44.332188 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:44.332707 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:44.332711 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.333428 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.333429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:44.334718 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:44.334723 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.335155 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.335156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:44.335343 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.335973 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:44.335973 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:44.336020 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:44.336053 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:44.336243 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:44.336250 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:44.336253 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:44.336341 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 18:53:44.336470 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":101,"threads_started":1}
I20260811 18:53:44.337365 7091 heartbeater.cc:347] Connected to a master server at 127.23.226.254:33115
I20260811 18:53:44.337479 7091 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:44.337684 7091 heartbeater.cc:511] Master 127.23.226.254:33115 requested a full tablet report, sending...
I20260811 18:53:44.338110 6663 ts_manager.cc:194] Registered new tserver with Master: 03edf319536c4e409ec56d735063fa0f (127.23.226.194:43997)
I20260811 18:53:44.338692 6663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.194:50303
W20260811 18:53:44.420379 7096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:44.420586 7096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:44.420608 7096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:44.421681 7096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:44.421723 7096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:44.421747 7096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:44.423022 7096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:33115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:44.423206 7096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:44.423447 7096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:44.428869 7106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.428887 7109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.428880 7107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:44.429029 7096 server_base.cc:1034] running on GCE node
I20260811 18:53:44.429385 7096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:44.429602 7096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:44.430755 7096 hybrid_clock.cc:648] HybridClock initialized: now 1786474424430742 us; error 32 us; skew 500 ppm
I20260811 18:53:44.432085 7096 webserver.cc:460] Webserver started at http://127.23.226.195:35781/ using document root <none> and password file <none>
I20260811 18:53:44.432288 7096 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:44.432330 7096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:44.432425 7096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:44.433471 7096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "a58f89137e144c018c369cd1c1fa9cfc"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "de424d92926a5d58d0b1af152dd48d56"
server_key_iv: "02c2da95c648dd9720e7308eba8dabf3"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.433797 7096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "a58f89137e144c018c369cd1c1fa9cfc"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "de424d92926a5d58d0b1af152dd48d56"
server_key_iv: "02c2da95c648dd9720e7308eba8dabf3"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.435220 7096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:44.435981 7120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.436223 7096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:44.436326 7096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "a58f89137e144c018c369cd1c1fa9cfc"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "de424d92926a5d58d0b1af152dd48d56"
server_key_iv: "02c2da95c648dd9720e7308eba8dabf3"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.436393 7096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:44.447821 7096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:44.448123 7096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:44.448240 7096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:44.448447 7096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:44.448781 7096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:44.448818 7096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.448843 7096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:44.448865 7096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.455498 7096 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:41019
I20260811 18:53:44.455613 7281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:41019 every 8 connection(s)
I20260811 18:53:44.455971 7096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:44.461777 6717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.456790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:44729 (local address 127.23.226.254:33115)
0811 18:53:44.456848 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.456866 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.457103 (+ 237us) server_negotiation.cc:407] Connection header received
0811 18:53:44.457675 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.457677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.457691 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.457759 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.458630 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.459139 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.460233 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.460435 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.460516 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.461436 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.461437 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.461438 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:44.461443 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.461459 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:44.461466 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.461534 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.461638 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.461670 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:53:44.462046 7287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.456754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33115 (local address 127.23.226.195:44729)
0811 18:53:44.456965 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:44.457001 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:44.457557 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:44.457834 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:44.457838 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:44.457848 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:44.458507 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:44.458513 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.459244 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.459246 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:44.460137 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:44.460140 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:44.460525 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:44.460526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:44.460682 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:44.461270 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:44.461271 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:44.461300 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:44.461324 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:44.461536 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:44.461543 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:44.461547 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:44.461640 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:53:44.461747 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260811 18:53:44.462126 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 7096
I20260811 18:53:44.462227 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:44.462478 24459 external_mini_cluster.cc:1428] Setting key f46867b8b8407772fa9b853f07fea77c
I20260811 18:53:44.462519 7282 heartbeater.cc:347] Connected to a master server at 127.23.226.254:33115
I20260811 18:53:44.462638 7282 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:44.462859 7282 heartbeater.cc:511] Master 127.23.226.254:33115 requested a full tablet report, sending...
I20260811 18:53:44.463279 6663 ts_manager.cc:194] Registered new tserver with Master: a58f89137e144c018c369cd1c1fa9cfc (127.23.226.195:41019)
I20260811 18:53:44.463778 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:53:44.463893 6663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.195:44729
W20260811 18:53:44.465741 6717 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:44.465236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47816 (local address 127.23.226.254:33115)
0811 18:53:44.465280 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.465282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.465432 (+ 150us) server_negotiation.cc:407] Connection header received
0811 18:53:44.465490 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.465491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.465500 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.465547 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.465663 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47816: BlockingRecv error: recv got EOF from 127.0.0.1:47816 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:53:44.465881 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 6748
I20260811 18:53:44.489008 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 6926
I20260811 18:53:44.495885 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 7096
I20260811 18:53:44.513414 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 6618
2026-08-11T18:53:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (679 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T18:53:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:44Z Disabled control of system clock
I20260811 18:53:44.545262 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:35413
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:41273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:35413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:53:44.629822 7298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:44.630043 7298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:44.630065 7298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:44.631214 7298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:44.631254 7298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:44.631268 7298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:44.631280 7298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:44.631294 7298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:44.632583 7298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:35413
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:35413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:44.632781 7298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:44.633042 7298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:44.638072 7308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.638105 7309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:44.638141 7298 server_base.cc:1034] running on GCE node
W20260811 18:53:44.638092 7311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:44.638600 7298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:44.638933 7298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:44.640136 7298 hybrid_clock.cc:648] HybridClock initialized: now 1786474424640110 us; error 39 us; skew 500 ppm
I20260811 18:53:44.641527 7298 webserver.cc:460] Webserver started at http://127.23.226.254:33413/ using document root <none> and password file <none>
I20260811 18:53:44.641819 7298 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:44.641896 7298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:44.642053 7298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:44.643214 7298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "75a4fc11d35d1869538f55d905b1b117"
server_key_iv: "88f738a0dd20c8a1af6738e26f7cc8e0"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.643594 7298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "75a4fc11d35d1869538f55d905b1b117"
server_key_iv: "88f738a0dd20c8a1af6738e26f7cc8e0"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.644915 7298 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:53:44.645668 7322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.645849 7298 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 18:53:44.645960 7298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "75a4fc11d35d1869538f55d905b1b117"
server_key_iv: "88f738a0dd20c8a1af6738e26f7cc8e0"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.646039 7298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:44.649504 7298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:44.649806 7298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:44.649961 7298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:44.654093 7298 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:35413
I20260811 18:53:44.654153 7395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:35413 every 8 connection(s)
I20260811 18:53:44.654592 7298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:44.655357 7397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:44.658182 7397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6: Bootstrap starting.
I20260811 18:53:44.658869 7397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:44.659180 7397 log.cc:824] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:44.660050 7397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6: No bootstrap required, opened a new log
I20260811 18:53:44.660123 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 7298
I20260811 18:53:44.660218 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:44.660439 24459 external_mini_cluster.cc:1428] Setting key 5f8ed63bf977324379a57ff32f9b9b3d
I20260811 18:53:44.662250 7397 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35413 } }
I20260811 18:53:44.662482 7397 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:44.662606 7397 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ecd72d7cf3458eb3a4cce3b4d515f6, State: Initialized, Role: FOLLOWER
I20260811 18:53:44.663066 7397 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35413 } }
I20260811 18:53:44.663196 7397 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:44.663251 7397 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:44.663314 7397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:44.664186 7402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.661052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35656 (local address 127.23.226.254:35413)
0811 18:53:44.661282 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.661289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.661315 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:53:44.662236 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.662246 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.662304 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.662477 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.663188 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.663192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.663193 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:44.663197 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.663244 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:44.663259 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.663323 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.663530 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.663605 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260811 18:53:44.664170 7397 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35413 } }
I20260811 18:53:44.664332 7397 leader_election.cc:302] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25ecd72d7cf3458eb3a4cce3b4d515f6; no voters:
I20260811 18:53:44.664510 7397 leader_election.cc:288] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:44.664563 7403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:44.664731 7403 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [term 1 LEADER]: Becoming Leader. State: Replica: 25ecd72d7cf3458eb3a4cce3b4d515f6, State: Running, Role: LEADER
I20260811 18:53:44.664851 7397 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:44.664885 7403 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35413 } }
I20260811 18:53:44.665318 7403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25ecd72d7cf3458eb3a4cce3b4d515f6. Latest consensus state: current_term: 1 leader_uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35413 } } }
I20260811 18:53:44.665329 7406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ecd72d7cf3458eb3a4cce3b4d515f6" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35413 } } }
I20260811 18:53:44.665539 7406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:44.665530 7403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:44.665925 7418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:44.666572 7418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:44.668313 7418 catalog_manager.cc:1347] Generated new cluster ID: 02a16342c33446d1a2f76130a4ff202b
I20260811 18:53:44.668363 7418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:53:44.697345 7418 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:44.697589 7418 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:44.705029 7418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25ecd72d7cf3458eb3a4cce3b4d515f6: Generated new TSK 0
I20260811 18:53:44.705288 7418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:53:44.712968 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:35413
--builtin_ntp_servers=127.23.226.212:41273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:53:44.799961 7434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:44.800225 7434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:44.800271 7434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:44.801476 7434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:44.801544 7434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:44.801584 7434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:44.803057 7434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:35413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:44.803351 7434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:44.803678 7434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:44.810148 7442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.810220 7439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.810221 7440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:44.810530 7434 server_base.cc:1034] running on GCE node
I20260811 18:53:44.810725 7434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:44.810930 7434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:44.812069 7434 hybrid_clock.cc:648] HybridClock initialized: now 1786474424812055 us; error 30 us; skew 500 ppm
I20260811 18:53:44.813689 7434 webserver.cc:460] Webserver started at http://127.23.226.193:38893/ using document root <none> and password file <none>
I20260811 18:53:44.813982 7434 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:44.814033 7434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:44.814210 7434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:44.815389 7434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "46c57cb570374147b6c6e24ea2aab114"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "d063292136285be15b894c75b4669b3b"
server_key_iv: "f6bd7dcefc2a964c9c4d80d23a1f21bb"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.815793 7434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "46c57cb570374147b6c6e24ea2aab114"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "d063292136285be15b894c75b4669b3b"
server_key_iv: "f6bd7dcefc2a964c9c4d80d23a1f21bb"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.817169 7434 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:53:44.817934 7449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.818114 7434 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:44.818219 7434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "46c57cb570374147b6c6e24ea2aab114"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "d063292136285be15b894c75b4669b3b"
server_key_iv: "f6bd7dcefc2a964c9c4d80d23a1f21bb"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.818307 7434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:44.821756 7434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:44.822036 7434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:44.822187 7434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:44.822399 7434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:44.822758 7434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:44.822817 7434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.822857 7434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:44.822885 7434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.828948 7434 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:45941
I20260811 18:53:44.828999 7599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:45941 every 8 connection(s)
I20260811 18:53:44.829371 7434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:44.832652 7402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.830246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:60133 (local address 127.23.226.254:35413)
0811 18:53:44.830344 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.830346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.830570 (+ 224us) server_negotiation.cc:407] Connection header received
0811 18:53:44.831120 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.831121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.831127 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.831212 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.832427 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.832429 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.832429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:44.832434 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.832451 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:44.832456 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.832514 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.832581 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.832597 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 18:53:44.832894 7602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.830119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:35413 (local address 127.23.226.193:60133)
0811 18:53:44.830379 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:44.830464 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:44.831019 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:44.831286 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:44.831290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:44.831299 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:44.832254 (+ 955us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:44.832254 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:44.832284 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:44.832314 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:44.832512 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:44.832514 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:44.832517 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:44.832572 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 18:53:44.832624 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":82,"threads_started":1}
I20260811 18:53:44.833460 7600 heartbeater.cc:347] Connected to a master server at 127.23.226.254:35413
I20260811 18:53:44.833570 7600 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:44.833743 7600 heartbeater.cc:511] Master 127.23.226.254:35413 requested a full tablet report, sending...
I20260811 18:53:44.834344 7352 ts_manager.cc:194] Registered new tserver with Master: 46c57cb570374147b6c6e24ea2aab114 (127.23.226.193:45941)
I20260811 18:53:44.839480 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 7434
I20260811 18:53:44.839560 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:44.839722 24459 external_mini_cluster.cc:1428] Setting key fa49030b1c0271cb71a3665f9e4cb111
I20260811 18:53:44.840700 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:35413
--builtin_ntp_servers=127.23.226.212:41273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 18:53:44.926657 7603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:44.926860 7603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:44.926883 7603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:44.927991 7603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:44.928027 7603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:44.928052 7603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:44.929337 7603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:35413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:44.929538 7603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:44.929807 7603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:44.935012 7616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.935119 7613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:44.935142 7614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:44.935180 7603 server_base.cc:1034] running on GCE node
I20260811 18:53:44.935482 7603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:44.935689 7603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:44.936868 7603 hybrid_clock.cc:648] HybridClock initialized: now 1786474424936853 us; error 46 us; skew 500 ppm
I20260811 18:53:44.938189 7603 webserver.cc:460] Webserver started at http://127.23.226.194:44143/ using document root <none> and password file <none>
I20260811 18:53:44.938547 7603 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:44.938621 7603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:44.938812 7603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:44.939914 7603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "ed58c350e4f544019ff9c9cd2ded99cb"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "66b5b761a4731fb0a42f0d8de628b5af"
server_key_iv: "8ad1437e65ce3e432ac7b9ea077f9e59"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.940286 7603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "ed58c350e4f544019ff9c9cd2ded99cb"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "66b5b761a4731fb0a42f0d8de628b5af"
server_key_iv: "8ad1437e65ce3e432ac7b9ea077f9e59"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.941617 7603 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:44.942369 7628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.942569 7603 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:44.942677 7603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "ed58c350e4f544019ff9c9cd2ded99cb"
format_stamp: "Formatted at 2026-08-11 18:53:44 on dist-test-slave-68xk"
server_key: "66b5b761a4731fb0a42f0d8de628b5af"
server_key_iv: "8ad1437e65ce3e432ac7b9ea077f9e59"
server_key_version: "encryptionkey@0"
I20260811 18:53:44.942742 7603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:44.946027 7603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:44.946307 7603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:44.946475 7603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:44.946693 7603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:44.947027 7603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:44.947060 7603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.947114 7603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:44.947141 7603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:44.953438 7603 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:37599
I20260811 18:53:44.953526 7791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:37599 every 8 connection(s)
I20260811 18:53:44.953871 7603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:44.956418 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 7603
I20260811 18:53:44.956504 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:44.956727 24459 external_mini_cluster.cc:1428] Setting key 4c9f9d4b8e59359a8e0527a7cc029f85
I20260811 18:53:44.957418 7402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.954792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:58517 (local address 127.23.226.254:35413)
0811 18:53:44.954865 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:44.954868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:44.955136 (+ 268us) server_negotiation.cc:407] Connection header received
0811 18:53:44.955621 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:44.955623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:44.955629 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:44.955693 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:44.957120 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:44.957122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:44.957122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:44.957128 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:44.957187 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:44.957193 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:44.957273 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:44.957320 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 18:53:44.957336 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:53:44.957636 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:44.954803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:35413 (local address 127.23.226.194:58517)
0811 18:53:44.955012 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:44.955047 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:44.955504 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:44.955776 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:44.955779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:44.955788 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:44.956928 (+ 1140us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:44.956928 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:44.956957 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:44.956987 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:44.957264 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:44.957267 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:44.957270 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:44.957327 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 18:53:44.957396 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260811 18:53:44.957881 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:35413
--builtin_ntp_servers=127.23.226.212:41273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 18:53:44.958140 7793 heartbeater.cc:347] Connected to a master server at 127.23.226.254:35413
I20260811 18:53:44.958258 7793 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:44.958451 7793 heartbeater.cc:511] Master 127.23.226.254:35413 requested a full tablet report, sending...
I20260811 18:53:44.958875 7352 ts_manager.cc:194] Registered new tserver with Master: ed58c350e4f544019ff9c9cd2ded99cb (127.23.226.194:37599)
W20260811 18:53:45.050510 7798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:45.050733 7798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:45.050757 7798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:45.051972 7798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:45.052024 7798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:45.052052 7798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:45.053416 7798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:35413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:45.053681 7798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:45.053996 7798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:45.059387 7814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:45.059417 7805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:45.059504 7798 server_base.cc:1034] running on GCE node
W20260811 18:53:45.059442 7809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:45.059888 7798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:45.060142 7798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:45.061321 7798 hybrid_clock.cc:648] HybridClock initialized: now 1786474425061311 us; error 34 us; skew 500 ppm
I20260811 18:53:45.062692 7798 webserver.cc:460] Webserver started at http://127.23.226.195:42281/ using document root <none> and password file <none>
I20260811 18:53:45.062939 7798 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:45.063009 7798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:45.063174 7798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:45.064265 7798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "873c7f6cceaa417b961deeb2ca6129f0"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-68xk"
server_key: "7ba8f36e035e795f2250f2e0cfd9a43d"
server_key_iv: "4c4b56e26d0ff494b8a6ec734d32444f"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.064729 7798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "873c7f6cceaa417b961deeb2ca6129f0"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-68xk"
server_key: "7ba8f36e035e795f2250f2e0cfd9a43d"
server_key_iv: "4c4b56e26d0ff494b8a6ec734d32444f"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.066321 7798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:53:45.067109 7824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.067312 7798 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:53:45.067413 7798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "873c7f6cceaa417b961deeb2ca6129f0"
format_stamp: "Formatted at 2026-08-11 18:53:45 on dist-test-slave-68xk"
server_key: "7ba8f36e035e795f2250f2e0cfd9a43d"
server_key_iv: "4c4b56e26d0ff494b8a6ec734d32444f"
server_key_version: "encryptionkey@0"
I20260811 18:53:45.067500 7798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:45.070927 7798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:45.071195 7798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:45.071338 7798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:45.071552 7798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:45.071903 7798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:45.071960 7798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.072002 7798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:45.072032 7798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:45.077593 7798 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:45991
I20260811 18:53:45.077666 7982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:45991 every 8 connection(s)
I20260811 18:53:45.077997 7798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:45.081357 7402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.078853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:54779 (local address 127.23.226.254:35413)
0811 18:53:45.078900 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:45.078902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:45.079178 (+ 276us) server_negotiation.cc:407] Connection header received
0811 18:53:45.079710 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:45.079712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:45.079719 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:45.079777 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:45.081029 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:45.081031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:45.081031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:53:45.081036 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:45.081059 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:53:45.081064 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:45.081131 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:45.081267 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 18:53:45.081285 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:53:45.081553 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:45.078837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:35413 (local address 127.23.226.195:54779)
0811 18:53:45.079053 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:45.079085 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:45.079580 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:45.079849 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:45.079853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:45.079862 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:45.080860 (+ 998us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:53:45.080860 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:45.080888 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:53:45.080916 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:45.081128 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:45.081135 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:45.081186 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 18:53:45.081277 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:53:45.081340 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":103,"threads_started":1}
I20260811 18:53:45.082057 7983 heartbeater.cc:347] Connected to a master server at 127.23.226.254:35413
I20260811 18:53:45.082185 7983 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:45.082373 7983 heartbeater.cc:511] Master 127.23.226.254:35413 requested a full tablet report, sending...
I20260811 18:53:45.082870 7352 ts_manager.cc:194] Registered new tserver with Master: 873c7f6cceaa417b961deeb2ca6129f0 (127.23.226.195:45991)
I20260811 18:53:45.083827 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 7798
I20260811 18:53:45.083912 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:45.084057 24459 external_mini_cluster.cc:1428] Setting key 5182d94429745375087ad8cae5f38e17
I20260811 18:53:45.084896 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 18:53:45.086870 7402 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:53:45.086386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35664 (local address 127.23.226.254:35413)
0811 18:53:45.086496 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:45.086498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:45.086603 (+ 105us) server_negotiation.cc:407] Connection header received
0811 18:53:45.086629 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:45.086630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:45.086634 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:45.086679 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:45.086807 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35664: BlockingRecv error: recv got EOF from 127.0.0.1:35664 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:53:45.086961 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 7434
I20260811 18:53:45.115911 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 7603
I20260811 18:53:45.127637 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 7798
I20260811 18:53:45.137742 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 7298
2026-08-11T18:53:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (625 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:45 dist-test-slave-68xk krb5kdc[7994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:45 dist-test-slave-68xk krb5kdc[7994](info): set up 2 sockets
Aug 11 18:53:45 dist-test-slave-68xk krb5kdc[7994](info): commencing operation
krb5kdc: starting...
W20260811 18:53:46.442536 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:46 dist-test-slave-68xk krb5kdc[7994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:53:46.575680 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:36235
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:36235
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:46.661474 8011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:46.661685 8011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:46.661708 8011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:46.662896 8011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:53:46.662937 8011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:46.662952 8011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:46.662966 8011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:53:46.662977 8011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:53:46.664474 8011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:36235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:36235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:46.664734 8011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:46.664975 8011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:46.670084 8017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:46.670166 8018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:46.670317 8011 server_base.cc:1034] running on GCE node
W20260811 18:53:46.670090 8020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:46.670804 8011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:46.671121 8011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:46.672268 8011 hybrid_clock.cc:648] HybridClock initialized: now 1786474426672248 us; error 42 us; skew 500 ppm
Aug 11 18:53:46 dist-test-slave-68xk krb5kdc[7994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474426, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:46.680394 8011 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:53:46.680922 8011 webserver.cc:460] Webserver started at http://127.23.226.254:40351/ using document root <none> and password file <none>
I20260811 18:53:46.681185 8011 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:46.681255 8011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:46.681423 8011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:46.682626 8011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "1fb08a2db60b436a8817d23260e97fd4"
format_stamp: "Formatted at 2026-08-11 18:53:46 on dist-test-slave-68xk"
server_key: "4767598721b72fd88a35c26a7f2c2963"
server_key_iv: "c88b2ef80cd2ece00274a90393b81d96"
server_key_version: "encryptionkey@0"
I20260811 18:53:46.683018 8011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "1fb08a2db60b436a8817d23260e97fd4"
format_stamp: "Formatted at 2026-08-11 18:53:46 on dist-test-slave-68xk"
server_key: "4767598721b72fd88a35c26a7f2c2963"
server_key_iv: "c88b2ef80cd2ece00274a90393b81d96"
server_key_version: "encryptionkey@0"
I20260811 18:53:46.684456 8011 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:46.685299 8028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:46.685493 8011 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:46.685608 8011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "1fb08a2db60b436a8817d23260e97fd4"
format_stamp: "Formatted at 2026-08-11 18:53:46 on dist-test-slave-68xk"
server_key: "4767598721b72fd88a35c26a7f2c2963"
server_key_iv: "c88b2ef80cd2ece00274a90393b81d96"
server_key_version: "encryptionkey@0"
I20260811 18:53:46.685684 8011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:46.697539 8011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:46.699817 8011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:46.699983 8011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:46.704463 8011 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:36235
I20260811 18:53:46.704510 8094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:36235 every 8 connection(s)
I20260811 18:53:46.704885 8011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:53:46.705914 8095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:46.708349 8095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4: Bootstrap starting.
I20260811 18:53:46.708979 8095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:46.709309 8095 log.cc:824] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:46.710171 8095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4: No bootstrap required, opened a new log
I20260811 18:53:46.711489 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 8011
I20260811 18:53:46.711576 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:53:46.711786 24459 external_mini_cluster.cc:1428] Setting key 6d4d73ad0b9d05f2a01fe84055060349
I20260811 18:53:46.711963 8095 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb08a2db60b436a8817d23260e97fd4" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36235 } }
I20260811 18:53:46.712186 8095 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:46.712231 8095 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fb08a2db60b436a8817d23260e97fd4, State: Initialized, Role: FOLLOWER
I20260811 18:53:46.712405 8095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb08a2db60b436a8817d23260e97fd4" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36235 } }
I20260811 18:53:46.712519 8095 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:53:46.712579 8095 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:53:46.712633 8095 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:46.713508 8095 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb08a2db60b436a8817d23260e97fd4" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36235 } }
I20260811 18:53:46.713639 8095 leader_election.cc:302] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fb08a2db60b436a8817d23260e97fd4; no voters:
I20260811 18:53:46.713826 8095 leader_election.cc:288] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:53:46.713860 8100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:46.713981 8100 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [term 1 LEADER]: Becoming Leader. State: Replica: 1fb08a2db60b436a8817d23260e97fd4, State: Running, Role: LEADER
I20260811 18:53:46.714113 8095 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:53:46.714128 8100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb08a2db60b436a8817d23260e97fd4" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36235 } }
I20260811 18:53:46.714493 8100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fb08a2db60b436a8817d23260e97fd4. Latest consensus state: current_term: 1 leader_uuid: "1fb08a2db60b436a8817d23260e97fd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb08a2db60b436a8817d23260e97fd4" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36235 } } }
I20260811 18:53:46.714509 8103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fb08a2db60b436a8817d23260e97fd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb08a2db60b436a8817d23260e97fd4" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36235 } } }
I20260811 18:53:46.714702 8103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:46.714932 8100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:53:46.715276 8115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:53:46.715888 8115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:53:46.717978 8115 catalog_manager.cc:1347] Generated new cluster ID: 0699af84d336433fa641bc242e335758
I20260811 18:53:46.718034 8115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:53:46 dist-test-slave-68xk krb5kdc[7994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:46.724198 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:46.712411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47612 (local address 127.23.226.254:36235)
0811 18:53:46.712632 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:46.712642 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:46.712705 (+ 63us) server_negotiation.cc:407] Connection header received
0811 18:53:46.712815 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:46.712820 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:46.712864 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:46.713006 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:46.713670 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:46.715091 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:46.716336 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:46.716940 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:46.717052 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:46.720223 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:46.720227 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:46.720228 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:46.720241 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:46.722389 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:46.722809 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:46.722813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:46.722813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:46.722940 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:46.723161 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:46.723162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:46.723162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:46.723501 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:46.723708 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:46.723795 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 18:53:46.723977 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":98,"threads_started":1}
I20260811 18:53:46.725540 8115 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:53:46.726046 8115 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:53:46.730829 8115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4: Generated new TSK 0
I20260811 18:53:46.731017 8115 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:53:46.766242 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:36235
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:46.854775 8134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:46.854990 8134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:46.855013 8134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:46.856164 8134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:46.856206 8134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:46.856233 8134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:53:46.857648 8134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:36235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:46.857837 8134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:46.858021 8134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:46.863710 8141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:46.863770 8146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:46.863770 8143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:46.864261 8134 server_base.cc:1034] running on GCE node
I20260811 18:53:46.864467 8134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:46.864678 8134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:46.865887 8134 hybrid_clock.cc:648] HybridClock initialized: now 1786474426865870 us; error 30 us; skew 500 ppm
Aug 11 18:53:46 dist-test-slave-68xk krb5kdc[7994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474426, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:46.868875 8134 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:53:46.869438 8134 webserver.cc:460] Webserver started at http://127.23.226.193:33137/ using document root <none> and password file <none>
I20260811 18:53:46.869716 8134 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:46.869799 8134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:46.869971 8134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:46.871243 8134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "774d8e0f9f7f4499a69ed19a59efdfc8"
format_stamp: "Formatted at 2026-08-11 18:53:46 on dist-test-slave-68xk"
server_key: "21f0f88a460b551758135033434727d1"
server_key_iv: "0bb4534065d05c217cbffb5f6bc83b7a"
server_key_version: "encryptionkey@0"
I20260811 18:53:46.871645 8134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "774d8e0f9f7f4499a69ed19a59efdfc8"
format_stamp: "Formatted at 2026-08-11 18:53:46 on dist-test-slave-68xk"
server_key: "21f0f88a460b551758135033434727d1"
server_key_iv: "0bb4534065d05c217cbffb5f6bc83b7a"
server_key_version: "encryptionkey@0"
I20260811 18:53:46.873190 8134 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:53:46.874127 8154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:46.874481 8134 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:46.874603 8134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "774d8e0f9f7f4499a69ed19a59efdfc8"
format_stamp: "Formatted at 2026-08-11 18:53:46 on dist-test-slave-68xk"
server_key: "21f0f88a460b551758135033434727d1"
server_key_iv: "0bb4534065d05c217cbffb5f6bc83b7a"
server_key_version: "encryptionkey@0"
I20260811 18:53:46.874688 8134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:46.894529 8134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:46.897113 8134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:46.897315 8134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:46.897576 8134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:46.897954 8134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:46.898013 8134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:46.898062 8134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:46.898121 8134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:46.904692 8134 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:37305
I20260811 18:53:46.904757 8302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:37305 every 8 connection(s)
I20260811 18:53:46.905112 8134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:53:46.912494 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 8134
I20260811 18:53:46.912616 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:53:46.912840 24459 external_mini_cluster.cc:1428] Setting key 0bdad2a06c217f3d72397a19696d0dfb
Aug 11 18:53:46 dist-test-slave-68xk krb5kdc[7994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474426, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:46.917285 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:46.905902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:58889 (local address 127.23.226.254:36235)
0811 18:53:46.905996 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:46.905999 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:46.906157 (+ 158us) server_negotiation.cc:407] Connection header received
0811 18:53:46.906813 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:46.906814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:46.906827 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:46.906894 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:46.908239 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:46.908971 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:46.910843 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:46.911128 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:46.911226 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:46.913727 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:46.913729 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:46.913729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:46.913737 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:46.915575 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:46.916163 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:46.916164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:46.916164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:46.916221 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:46.916522 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:46.916523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:46.916523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:46.916637 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:46.916688 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:46.917056 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 18:53:46.917149 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 18:53:46.917474 8305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:46.905846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:36235 (local address 127.23.226.193:58889)
0811 18:53:46.906027 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:46.906069 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:46.906683 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:46.906978 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:46.906983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:46.907714 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:46.908114 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:46.908122 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:46.909081 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:46.909082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:46.910727 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:46.910730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:46.911239 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:46.911241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:46.911390 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:46.911898 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:46.911907 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:46.913652 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:46.915681 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:46.915691 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:46.915693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:46.916085 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:46.916295 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:46.916296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:46.916297 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:46.916453 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:46.916706 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:46.916713 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:46.916891 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 18:53:46.917030 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 18:53:46.917216 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":103,"threads_started":1}
I20260811 18:53:46.918093 8303 heartbeater.cc:347] Connected to a master server at 127.23.226.254:36235
I20260811 18:53:46.918233 8303 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:46.918516 8303 heartbeater.cc:511] Master 127.23.226.254:36235 requested a full tablet report, sending...
I20260811 18:53:46.919103 8048 ts_manager.cc:194] Registered new tserver with Master: 774d8e0f9f7f4499a69ed19a59efdfc8 (127.23.226.193:37305)
I20260811 18:53:46.919734 8048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:58889
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:53:46.941970 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:36235
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:47.032115 8309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:47.032335 8309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:47.032359 8309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:47.033432 8309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:47.033466 8309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:47.033491 8309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:53:47.035023 8309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:36235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:47.035233 8309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:47.035421 8309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:47.040581 8318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:47.040566 8321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:47.040652 8317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:47.040943 8309 server_base.cc:1034] running on GCE node
I20260811 18:53:47.041182 8309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:47.041447 8309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:47.042626 8309 hybrid_clock.cc:648] HybridClock initialized: now 1786474427042611 us; error 26 us; skew 500 ppm
Aug 11 18:53:47 dist-test-slave-68xk krb5kdc[7994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474427, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:47.045136 8309 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:53:47.045583 8309 webserver.cc:460] Webserver started at http://127.23.226.194:39643/ using document root <none> and password file <none>
I20260811 18:53:47.045838 8309 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:47.045909 8309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:47.046060 8309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:47.047185 8309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "4b807977d7604879b93f26b040dc9f24"
format_stamp: "Formatted at 2026-08-11 18:53:47 on dist-test-slave-68xk"
server_key: "fbe0e4edaa9a881ec97fec71b6773445"
server_key_iv: "6d0221b72a981b4488a9a2c8eb8d5c2a"
server_key_version: "encryptionkey@0"
I20260811 18:53:47.047581 8309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "4b807977d7604879b93f26b040dc9f24"
format_stamp: "Formatted at 2026-08-11 18:53:47 on dist-test-slave-68xk"
server_key: "fbe0e4edaa9a881ec97fec71b6773445"
server_key_iv: "6d0221b72a981b4488a9a2c8eb8d5c2a"
server_key_version: "encryptionkey@0"
I20260811 18:53:47.048951 8309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:53:47.049711 8330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:47.049911 8309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:53:47.050022 8309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "4b807977d7604879b93f26b040dc9f24"
format_stamp: "Formatted at 2026-08-11 18:53:47 on dist-test-slave-68xk"
server_key: "fbe0e4edaa9a881ec97fec71b6773445"
server_key_iv: "6d0221b72a981b4488a9a2c8eb8d5c2a"
server_key_version: "encryptionkey@0"
I20260811 18:53:47.050097 8309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:47.061969 8309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:47.064285 8309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:47.064457 8309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:47.064719 8309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:47.065064 8309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:47.065122 8309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:47.065160 8309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:47.065191 8309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:47.071455 8309 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:44087
I20260811 18:53:47.071511 8498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:44087 every 8 connection(s)
I20260811 18:53:47.071834 8309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:53:47.077875 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 8309
I20260811 18:53:47.077997 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:53:47.078207 24459 external_mini_cluster.cc:1428] Setting key d1cacec780b0a234e355c65b9c5d1e6f
Aug 11 18:53:47 dist-test-slave-68xk krb5kdc[7994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474427, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:47.081952 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.072582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:44817 (local address 127.23.226.254:36235)
0811 18:53:47.072632 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.072634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.072907 (+ 273us) server_negotiation.cc:407] Connection header received
0811 18:53:47.073523 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.073524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.073538 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.073596 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:47.074640 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.075140 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.076149 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.076350 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.076430 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.078937 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:47.078938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:47.078939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:47.078953 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:47.080449 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:47.080901 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:47.080902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:47.080902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:47.080963 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:47.081265 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:47.081266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:47.081266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:47.081386 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:47.081465 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.081775 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.081861 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:53:47.082163 8503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.072571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:36235 (local address 127.23.226.194:44817)
0811 18:53:47.072781 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:47.072817 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:47.073396 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:47.073681 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:47.073692 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:47.074281 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:47.074543 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.074549 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.075255 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.075256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.076054 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.076056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.076439 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.076440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.076570 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.077052 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:47.077060 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:47.078804 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:47.080558 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:47.080567 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:47.080569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:47.080805 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:47.081061 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:47.081062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:47.081063 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:47.081193 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:47.081464 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:47.081473 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:47.081631 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 18:53:47.081740 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 18:53:47.081900 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":113,"threads_started":1}
I20260811 18:53:47.082763 8499 heartbeater.cc:347] Connected to a master server at 127.23.226.254:36235
I20260811 18:53:47.082872 8499 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:47.083081 8499 heartbeater.cc:511] Master 127.23.226.254:36235 requested a full tablet report, sending...
I20260811 18:53:47.083469 8048 ts_manager.cc:194] Registered new tserver with Master: 4b807977d7604879b93f26b040dc9f24 (127.23.226.194:44087)
I20260811 18:53:47.083865 8048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:44817
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:53:47.105952 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:36235
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:53:47.190685 8506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:53:47.190915 8506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:53:47.190939 8506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:53:47.192111 8506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:53:47.192154 8506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:53:47.192180 8506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:53:47.193655 8506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:36235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:53:47.193913 8506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:53:47.194164 8506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:53:47.199339 8517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:47.199397 8522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:53:47.199584 8518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:53:47.199592 8506 server_base.cc:1034] running on GCE node
I20260811 18:53:47.199884 8506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:53:47.200140 8506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:53:47.201344 8506 hybrid_clock.cc:648] HybridClock initialized: now 1786474427201316 us; error 43 us; skew 500 ppm
Aug 11 18:53:47 dist-test-slave-68xk krb5kdc[7994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474427, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:53:47.204630 8506 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:53:47.205307 8506 webserver.cc:460] Webserver started at http://127.23.226.195:34231/ using document root <none> and password file <none>
I20260811 18:53:47.205610 8506 fs_manager.cc:359] Metadata directory not provided
I20260811 18:53:47.205694 8506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:53:47.205865 8506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:53:47.207319 8506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "0f19fefd86604437b0b2342da6edd7c4"
format_stamp: "Formatted at 2026-08-11 18:53:47 on dist-test-slave-68xk"
server_key: "04ec8b3a1cfb4776466c290b063c8f7a"
server_key_iv: "db1e5db988d9c580c2fe080aff9bff56"
server_key_version: "encryptionkey@0"
I20260811 18:53:47.207770 8506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "0f19fefd86604437b0b2342da6edd7c4"
format_stamp: "Formatted at 2026-08-11 18:53:47 on dist-test-slave-68xk"
server_key: "04ec8b3a1cfb4776466c290b063c8f7a"
server_key_iv: "db1e5db988d9c580c2fe080aff9bff56"
server_key_version: "encryptionkey@0"
I20260811 18:53:47.209390 8506 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:53:47.210490 8529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:47.210749 8506 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:53:47.210876 8506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "0f19fefd86604437b0b2342da6edd7c4"
format_stamp: "Formatted at 2026-08-11 18:53:47 on dist-test-slave-68xk"
server_key: "04ec8b3a1cfb4776466c290b063c8f7a"
server_key_iv: "db1e5db988d9c580c2fe080aff9bff56"
server_key_version: "encryptionkey@0"
I20260811 18:53:47.210975 8506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:53:47.228137 8506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:53:47.230243 8506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:53:47.230448 8506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:53:47.230711 8506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:53:47.231104 8506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:53:47.231161 8506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:47.231204 8506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:53:47.231230 8506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:53:47.237591 8506 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:36481
I20260811 18:53:47.237643 8697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:36481 every 8 connection(s)
I20260811 18:53:47.237967 8506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:53:47.241631 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 8506
I20260811 18:53:47.241770 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:53:47.241962 24459 external_mini_cluster.cc:1428] Setting key 2ec6a11036d16d5c6c4603212c16a550
Aug 11 18:53:47 dist-test-slave-68xk krb5kdc[7994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474427, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:53:47.248076 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.238733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:58413 (local address 127.23.226.254:36235)
0811 18:53:47.238834 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.238836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.239006 (+ 170us) server_negotiation.cc:407] Connection header received
0811 18:53:47.239556 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.239557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.239571 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.239637 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:47.240656 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.241162 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.242330 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.242696 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.242768 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.245217 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:47.245218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:47.245218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:47.245225 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:47.246847 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:47.247243 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:47.247243 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:47.247244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:47.247294 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:47.247520 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:47.247520 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:47.247520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:47.247619 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:47.247683 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.247952 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.248013 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 18:53:47.248356 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.238646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:36235 (local address 127.23.226.195:58413)
0811 18:53:47.238871 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:47.238918 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:47.239447 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:47.239709 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:47.239713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:47.240343 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:53:47.240539 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.240544 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.241264 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.241265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.242261 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.242264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.242862 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.242863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.243040 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.243597 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:53:47.243606 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:53:47.245126 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:53:47.246923 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:47.246930 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:47.246932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:47.247174 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:47.247356 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:53:47.247357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:53:47.247357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:53:47.247463 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:53:47.247699 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:53:47.247709 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:53:47.247834 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 18:53:47.247926 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 18:53:47.248057 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":90,"threads_started":1}
I20260811 18:53:47.248917 8698 heartbeater.cc:347] Connected to a master server at 127.23.226.254:36235
I20260811 18:53:47.249013 8698 heartbeater.cc:464] Registering TS with master...
I20260811 18:53:47.249158 8698 heartbeater.cc:511] Master 127.23.226.254:36235 requested a full tablet report, sending...
I20260811 18:53:47.249544 8048 ts_manager.cc:194] Registered new tserver with Master: 0f19fefd86604437b0b2342da6edd7c4 (127.23.226.195:36481)
I20260811 18:53:47.249886 8048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:58413
I20260811 18:53:47.254005 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:53:47.261693 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.255463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47626 (local address 127.23.226.254:36235)
0811 18:53:47.255531 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.255532 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.255635 (+ 103us) server_negotiation.cc:407] Connection header received
0811 18:53:47.255674 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.255674 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.255683 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.255735 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:53:47.256305 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.256759 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.257460 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.257641 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.257696 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.259110 (+ 1414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:53:47.259111 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:53:47.259112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:53:47.259118 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:53:47.260582 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:47.260961 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:47.260962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:47.260963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:47.261024 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:53:47.261221 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:53:47.261221 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:53:47.261221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:53:47.261376 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:53:47.261461 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.261554 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.261625 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:53:47.263406 8048 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:53:47.264979 8048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:53:47.272152 8720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.267747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:37305 (local address 127.0.0.1:57588)
0811 18:53:47.267916 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:47.267959 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:47.268030 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:47.268591 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:47.268595 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:47.268597 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:47.268715 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.268718 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.270177 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.270178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.271121 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.271125 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.271847 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.271848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.271927 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.271942 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:53:47.272009 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 18:53:47.272065 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":5,"thread_start_us":99,"threads_started":1}
I20260811 18:53:47.272428 8726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.268151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57588 (local address 127.23.226.193:37305)
0811 18:53:47.268384 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.268390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.268402 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:53:47.268445 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.268447 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.268465 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.268801 (+ 336us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:47.268892 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.270042 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.271205 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.271744 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.271838 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.271901 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.272301 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.272351 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":108,"threads_started":1}
I20260811 18:53:47.272555 8729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.268177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50668 (local address 127.23.226.195:36481)
0811 18:53:47.268410 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.268416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.268641 (+ 225us) server_negotiation.cc:407] Connection header received
0811 18:53:47.268689 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.268692 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.268708 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.268789 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:47.268904 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.270012 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.271278 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.271965 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.272030 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.272075 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.272410 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.272452 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":127,"threads_started":1}
I20260811 18:53:47.272547 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.267905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.23.226.194:44087)
0811 18:53:47.268419 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.268423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.268434 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:47.268475 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.268477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.268493 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.268815 (+ 322us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:47.268900 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.269590 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.271154 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.271901 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.271981 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.272041 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.272141 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.272193 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":98,"threads_started":1}
I20260811 18:53:47.272850 8721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.267747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:44087 (local address 127.0.0.1:38184)
0811 18:53:47.267917 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:47.267959 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:47.268031 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:47.268630 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:47.268631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:47.268633 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:47.268702 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.268704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.269716 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.269717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.271051 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.271054 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.271990 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.271991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.272047 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.272050 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:47.272100 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 18:53:47.272144 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":5,"thread_start_us":60,"threads_started":1}
I20260811 18:53:47.273075 8723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.267955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:36481 (local address 127.0.0.1:50668)
0811 18:53:47.268509 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:47.268519 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:47.268570 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:47.268798 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:47.268799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:47.268801 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:47.268836 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.268837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.270123 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.270124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.271212 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.271215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.272117 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.272118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.272181 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.272185 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:53:47.272238 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:53:47.272285 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":75,"threads_started":1}
I20260811 18:53:47.273258 8220 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600 (DEFAULT_TABLE table=test-table [id=1dbe5287f370460c8f179e5a9f325271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:47.273675 8220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:47.273736 8605 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600 (DEFAULT_TABLE table=test-table [id=1dbe5287f370460c8f179e5a9f325271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:47.274114 8605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:47.274881 8400 tablet_service.cc:1467] Processing CreateTablet for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600 (DEFAULT_TABLE table=test-table [id=1dbe5287f370460c8f179e5a9f325271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:53:47.275215 8400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:53:47.276787 8732 tablet_bootstrap.cc:492] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8: Bootstrap starting.
I20260811 18:53:47.277491 8732 tablet_bootstrap.cc:654] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:47.277653 8734 tablet_bootstrap.cc:492] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: Bootstrap starting.
I20260811 18:53:47.278170 8732 log.cc:824] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:47.278512 8734 tablet_bootstrap.cc:654] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:47.278772 8736 tablet_bootstrap.cc:492] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Bootstrap starting.
I20260811 18:53:47.279198 8732 tablet_bootstrap.cc:492] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8: No bootstrap required, opened a new log
I20260811 18:53:47.279179 8734 log.cc:824] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:47.279274 8732 ts_tablet_manager.cc:1397] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 18:53:47.279917 8736 tablet_bootstrap.cc:654] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Neither blocks nor log segments found. Creating new log.
I20260811 18:53:47.280030 8734 tablet_bootstrap.cc:492] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: No bootstrap required, opened a new log
I20260811 18:53:47.280112 8734 ts_tablet_manager.cc:1397] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 18:53:47.280551 8736 log.cc:824] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Log is configured to *not* fsync() on all Append() calls
I20260811 18:53:47.281235 8732 raft_consensus.cc:348] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.281387 8732 raft_consensus.cc:374] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:47.281431 8732 raft_consensus.cc:729] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 774d8e0f9f7f4499a69ed19a59efdfc8, State: Initialized, Role: FOLLOWER
I20260811 18:53:47.281456 8736 tablet_bootstrap.cc:492] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: No bootstrap required, opened a new log
I20260811 18:53:47.281515 8736 ts_tablet_manager.cc:1397] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:53:47.281564 8732 consensus_queue.cc:260] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.281869 8303 heartbeater.cc:503] Master 127.23.226.254:36235 was elected leader, sending a full tablet report...
I20260811 18:53:47.282187 8732 ts_tablet_manager.cc:1428] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 18:53:47.282163 8734 raft_consensus.cc:348] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.282328 8734 raft_consensus.cc:374] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:47.282373 8734 raft_consensus.cc:729] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f19fefd86604437b0b2342da6edd7c4, State: Initialized, Role: FOLLOWER
I20260811 18:53:47.282507 8734 consensus_queue.cc:260] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.282814 8734 ts_tablet_manager.cc:1428] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 18:53:47.282820 8698 heartbeater.cc:503] Master 127.23.226.254:36235 was elected leader, sending a full tablet report...
I20260811 18:53:47.284127 8736 raft_consensus.cc:348] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.284248 8736 raft_consensus.cc:374] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:53:47.284269 8736 raft_consensus.cc:729] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b807977d7604879b93f26b040dc9f24, State: Initialized, Role: FOLLOWER
I20260811 18:53:47.284395 8736 consensus_queue.cc:260] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.284670 8736 ts_tablet_manager.cc:1428] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:53:47.284708 8499 heartbeater.cc:503] Master 127.23.226.254:36235 was elected leader, sending a full tablet report...
W20260811 18:53:47.322503 8501 tablet.cc:2369] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:53:47.350966 8739 raft_consensus.cc:482] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:53:47.351112 8739 raft_consensus.cc:504] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.351609 8739 leader_election.cc:288] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b807977d7604879b93f26b040dc9f24 (127.23.226.194:44087), 0f19fefd86604437b0b2342da6edd7c4 (127.23.226.195:36481)
I20260811 18:53:47.355036 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.352079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:38669 (local address 127.23.226.194:44087)
0811 18:53:47.352143 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.352145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.352155 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:53:47.352185 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.352186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.352197 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.352265 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:47.352523 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.353047 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.354110 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.354658 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.354718 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.354726 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.354914 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.354962 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:53:47.355013 8305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.351818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:44087 (local address 127.23.226.193:38669)
0811 18:53:47.351892 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:47.351907 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:47.351997 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:47.352308 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:47.352310 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:47.352312 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:47.352403 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.352405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.353103 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.353104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.354034 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.354037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.354738 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.354739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.354829 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.354832 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:53:47.354885 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:53:47.354915 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":4}
I20260811 18:53:47.355116 8729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.352062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:34415 (local address 127.23.226.195:36481)
0811 18:53:47.352116 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.352118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.352286 (+ 168us) server_negotiation.cc:407] Connection header received
0811 18:53:47.352323 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.352324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.352334 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.352401 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:53:47.352600 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.353180 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.354168 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.354734 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.354808 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.354816 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.354994 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.355039 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:53:47.355348 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.351948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:36481 (local address 127.23.226.193:34415)
0811 18:53:47.352210 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:47.352220 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:53:47.352276 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:53:47.352417 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:53:47.352417 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:53:47.352419 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:53:47.352511 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.352513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.353276 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.353277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.354064 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:53:47.354067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.354826 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.354827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:53:47.354907 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.354912 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:53:47.354969 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 18:53:47.355006 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":3,"thread_start_us":154,"threads_started":1}
I20260811 18:53:47.355535 8427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b2672ca5a2a446eb2fbaf5cdc5b9600" candidate_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b807977d7604879b93f26b040dc9f24" is_pre_election: true
I20260811 18:53:47.355746 8427 raft_consensus.cc:2454] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 774d8e0f9f7f4499a69ed19a59efdfc8 in term 0.
I20260811 18:53:47.355804 8627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b2672ca5a2a446eb2fbaf5cdc5b9600" candidate_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f19fefd86604437b0b2342da6edd7c4" is_pre_election: true
I20260811 18:53:47.355988 8627 raft_consensus.cc:2454] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 774d8e0f9f7f4499a69ed19a59efdfc8 in term 0.
I20260811 18:53:47.356029 8156 leader_election.cc:302] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b807977d7604879b93f26b040dc9f24, 774d8e0f9f7f4499a69ed19a59efdfc8; no voters:
I20260811 18:53:47.356249 8739 raft_consensus.cc:2781] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:53:47.356310 8739 raft_consensus.cc:482] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:53:47.356341 8739 raft_consensus.cc:3037] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:47.357122 8739 raft_consensus.cc:504] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.357275 8739 leader_election.cc:288] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [CANDIDATE]: Term 1 election: Requested vote from peers 4b807977d7604879b93f26b040dc9f24 (127.23.226.194:44087), 0f19fefd86604437b0b2342da6edd7c4 (127.23.226.195:36481)
I20260811 18:53:47.357466 8427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b2672ca5a2a446eb2fbaf5cdc5b9600" candidate_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b807977d7604879b93f26b040dc9f24"
I20260811 18:53:47.357475 8627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b2672ca5a2a446eb2fbaf5cdc5b9600" candidate_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f19fefd86604437b0b2342da6edd7c4"
I20260811 18:53:47.357568 8427 raft_consensus.cc:3037] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:47.357568 8627 raft_consensus.cc:3037] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:53:47.358343 8427 raft_consensus.cc:2454] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 774d8e0f9f7f4499a69ed19a59efdfc8 in term 1.
I20260811 18:53:47.358352 8627 raft_consensus.cc:2454] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 774d8e0f9f7f4499a69ed19a59efdfc8 in term 1.
I20260811 18:53:47.358593 8156 leader_election.cc:302] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f19fefd86604437b0b2342da6edd7c4, 774d8e0f9f7f4499a69ed19a59efdfc8; no voters:
I20260811 18:53:47.358706 8739 raft_consensus.cc:2781] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:53:47.358884 8739 raft_consensus.cc:686] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 1 LEADER]: Becoming Leader. State: Replica: 774d8e0f9f7f4499a69ed19a59efdfc8, State: Running, Role: LEADER
I20260811 18:53:47.358989 8739 consensus_queue.cc:237] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } }
I20260811 18:53:47.359892 8048 catalog_manager.cc:5495] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 774d8e0f9f7f4499a69ed19a59efdfc8 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "774d8e0f9f7f4499a69ed19a59efdfc8" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37305 } health_report { overall_health: HEALTHY } } }
I20260811 18:53:47.389160 8726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.386349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57596 (local address 127.23.226.193:37305)
0811 18:53:47.386468 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 18:53:47.386470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:53:47.386481 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:53:47.386561 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:53:47.386562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:53:47.386588 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:53:47.386666 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:53:47.386856 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.387375 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.388361 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:53:47.388584 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:53:47.388654 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:53:47.388799 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:53:47.388902 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:53:47.388964 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:53:47.389019 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 18:53:47.389035 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:53:47.391240 8427 raft_consensus.cc:1261] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 1 FOLLOWER]: Refusing update from remote peer 774d8e0f9f7f4499a69ed19a59efdfc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:47.391240 8627 raft_consensus.cc:1261] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 1 FOLLOWER]: Refusing update from remote peer 774d8e0f9f7f4499a69ed19a59efdfc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:53:47.391661 8739 consensus_queue.cc:1035] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b807977d7604879b93f26b040dc9f24" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:47.391841 8744 consensus_queue.cc:1035] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f19fefd86604437b0b2342da6edd7c4" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:53:47.394572 8747 mvcc.cc:205] Tried to move back new op lower bound from 7317399254591352832 to 7317399254462984192. Current Snapshot: MvccSnapshot[applied={T|T < 7317399254591352832}]
I20260811 18:53:47.397840 8048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:47.397949 8048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:53:47.398844 8048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1fb08a2db60b436a8817d23260e97fd4: Sending DeleteTablet for 3 replicas of tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600
I20260811 18:53:47.399215 8220 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:47 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:57588
I20260811 18:53:47.399286 8400 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:47 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:38184
I20260811 18:53:47.399461 8764 tablet_replica.cc:330] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8: stopping tablet replica
I20260811 18:53:47.399566 8764 raft_consensus.cc:2229] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:53:47.399542 8605 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:53:47 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:50668
I20260811 18:53:47.399678 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 8134
I20260811 18:53:47.399706 8764 raft_consensus.cc:2258] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 774d8e0f9f7f4499a69ed19a59efdfc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:47.399873 8771 tablet_replica.cc:330] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: stopping tablet replica
I20260811 18:53:47.399955 8771 raft_consensus.cc:2229] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:47.400038 8771 raft_consensus.cc:2258] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:47.400496 8771 ts_tablet_manager.cc:1905] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:47.402064 8771 ts_tablet_manager.cc:1918] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:47.402148 8771 log.cc:1196] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/8b2672ca5a2a446eb2fbaf5cdc5b9600
I20260811 18:53:47.402395 8771 ts_tablet_manager.cc:1939] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 0f19fefd86604437b0b2342da6edd7c4: Deleting consensus metadata
I20260811 18:53:47.402889 8029 catalog_manager.cc:4841] TS 0f19fefd86604437b0b2342da6edd7c4 (127.23.226.195:36481): tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600 (table test-table [id=1dbe5287f370460c8f179e5a9f325271]) successfully deleted
I20260811 18:53:47.407223 8769 tablet_replica.cc:330] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: stopping tablet replica
I20260811 18:53:47.407367 8769 raft_consensus.cc:2229] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:53:47.407510 8769 raft_consensus.cc:2258] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:53:47.407963 8769 ts_tablet_manager.cc:1905] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:53:47.409422 8769 ts_tablet_manager.cc:1918] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:53:47.409495 8769 log.cc:1196] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/8b2672ca5a2a446eb2fbaf5cdc5b9600
I20260811 18:53:47.409823 8769 ts_tablet_manager.cc:1939] T 8b2672ca5a2a446eb2fbaf5cdc5b9600 P 4b807977d7604879b93f26b040dc9f24: Deleting consensus metadata
I20260811 18:53:47.410320 8029 catalog_manager.cc:4841] TS 4b807977d7604879b93f26b040dc9f24 (127.23.226.194:44087): tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600 (table test-table [id=1dbe5287f370460c8f179e5a9f325271]) successfully deleted
W20260811 18:53:47.411621 8032 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:37305 (error 108)
I20260811 18:53:47.412245 8723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:53:47.412111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:37305 (local address 127.0.0.1:57608)
0811 18:53:47.412178 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 18:53:47.412217 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:37305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 18:53:47.412309 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 8309
W20260811 18:53:47.412407 8032 catalog_manager.cc:4584] TS 774d8e0f9f7f4499a69ed19a59efdfc8 (127.23.226.193:37305): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b2672ca5a2a446eb2fbaf5cdc5b9600: Network error: Client connection negotiation failed: client connection to 127.23.226.193:37305: connect: Connection refused (error 111)
I20260811 18:53:47.424925 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 8506
I20260811 18:53:47.436321 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 8011
2026-08-11T18:53:47Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2301 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:53:47 dist-test-slave-68xk krb5kdc[8778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:53:47 dist-test-slave-68xk krb5kdc[8778](info): set up 2 sockets
Aug 11 18:53:47 dist-test-slave-68xk krb5kdc[8778](info): commencing operation
krb5kdc: starting...
W20260811 18:53:48.700943 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:53:48 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:53:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:53:48Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.23.226.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.23.226.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/rangeradmin_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/rangeradmin_127.23.226.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.23.226.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.23.226.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/rangerlookup_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/rangerlookup_127.23.226.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.226.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.23.226.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/HTTP_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/HTTP_127.23.226.212@KRBTEST.COM.keytab.
I20260811 18:53:48.886133 24459 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskMIbuVm/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/postgres -l logfile start
2026-08-11 18:53:51.614 UTC [8826] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 18:53:51.614 UTC [8826] LOG: listening on IPv4 address "127.23.226.212", port 43539
2026-08-11 18:53:51.617 UTC [8826] LOG: listening on Unix socket "/tmp/.s.PGSQL.43539"
2026-08-11 18:53:51.641 UTC [8830] LOG: database system was shut down at 2026-08-11 18:53:49 UTC
2026-08-11 18:53:51.646 UTC [8826] LOG: database system is ready to accept connections
I20260811 18:53:52.818374 24459 mini_postgres.cc:96] Postgres bound to 43539
2026-08-11 18:53:52.826 UTC [8841] FATAL: database "slave" does not exist
127.23.226.212:43539 - accepting connections
I20260811 18:53:52.826779 24459 mini_ranger.cc:161] Starting Ranger...
I20260811 18:53:52.842767 24459 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 18:53:53.385778 24459 mini_ranger.cc:87] Created ranger Postgres database
I20260811 18:53:53.385890 24459 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-admin
2026-08-11 18:53:53,719 [I] DB FLAVOR :POSTGRES
2026-08-11 18:53:53,720 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:53:53,720 [I] Checking connection..
2026-08-11 18:53:53,720 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 18:53:53,987 [I] Checking connection passed.
2026-08-11 18:53:53,987 [I] --------- Verifying version history table ---------
2026-08-11 18:53:53,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:53:54,258 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:53:54,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:53:54,526 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:53:54,526 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 18:53:54,526 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 18:53:54.800 UTC [8936] WARNING: there is no transaction in progress
2026-08-11 18:53:54,809 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 18:53:54,810 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:53:55,074 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 18:53:55,074 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:53:55,074 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 18:53:55,330 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 18:53:55,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-68xk.c.gcp-upstream.internal','N') ;"
2026-08-11 18:53:55,862 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:53:56,153 [I] Table x_portal_user does not exist in database ranger
2026-08-11 18:53:56,154 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:53:56,421 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 18:53:56,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:53:56,705 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:53:56,951 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 18:53:56,952 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 18:53:57.963 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:57.982 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:57.999 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.018 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.038 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.067 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.125 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.133 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.149 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.159 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.170 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.184 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.194 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.201 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.208 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58.215 UTC [9088] WARNING: there is no transaction in progress
2026-08-11 18:53:58,937 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 18:53:58,937 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 18:53:59,189 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 18:53:59,189 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:53:59,427 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 18:53:59,428 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:53:59,676 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 18:53:59,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:53:59,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:54:00,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-68xk.c.gcp-upstream.internal';"
2026-08-11 18:54:00,464 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 18:54:00,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 18:54:00,750 [I] DB_PATCHES have already been applied
I20260811 18:54:00.756359 24459 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-admin:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskMIbuVm/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 18:54:00.756424 24459 mini_ranger.cc:193] Using host: 127.23.226.212
I20260811 18:54:00.760280 24459 mini_ranger.cc:227] Ranger admin URL: http://127.23.226.212:35799
Aug 11, 2026 6:54:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:54:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:54:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:54:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:54:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:54:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:54:01 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 18:54:02.236336 24459 mini_ranger.cc:160] Time spent starting Ranger: real 9.410s user 0.000s sys 0.012s
Aug 11, 2026 6:54:21 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:54:21 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 6:54:21 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:54:22 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:54:23 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 18:54:23.601270 24459 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.23.226.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.23.226.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/rangerkms_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/rangerkms_127.23.226.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.226.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.23.226.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.226.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/HTTP_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.226.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/HTTP_127.23.226.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 18:54:23 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474463, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 18:54:23.687786 24459 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 18:54:23.697778 24459 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 18:54:24.646334 24459 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 18:54:24.646446 24459 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms
I20260811 18:54:24.646471 24459 mini_ranger_kms.cc:227] Using postgres at 127.23.226.212:43539
2026-08-11 18:54:25,120 [I] DB FLAVOR :POSTGRES
2026-08-11 18:54:25,120 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:54:25,120 [I] Checking connection
2026-08-11 18:54:25,120 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 18:54:25,459 [I] connection success
2026-08-11 18:54:25,459 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 18:54:25,459 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 18:54:25,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 18:54:25,706 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 18:54:25,706 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:54:25,707 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 18:54:25,707 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:43539/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 18:54:25,994 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 18:54:26.486253 24459 mini_ranger_kms.cc:310] Created kms service
I20260811 18:54:26.674983 24459 mini_ranger_kms.cc:326] Created kudu user
I20260811 18:54:26.720809 24459 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 18:54:26 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474463, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:54:27.151593 24459 mini_ranger_kms.cc:384] Added ranger policy
I20260811 18:54:27.151719 24459 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms:/tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 18:54:27.151742 24459 mini_ranger_kms.cc:240] Using host: 127.23.226.212
I20260811 18:54:27.156800 24459 mini_ranger_kms.cc:276] Ranger KMS PID: 9345
I20260811 18:54:27.156919 24459 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.23.226.212:51679
Aug 11, 2026 6:54:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:54:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:54:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:54:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:54:29 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:54:29 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 18:54:30 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474470, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.226.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:30.098985 24459 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.411s user 0.010s sys 0.326s
I20260811 18:54:30.099115 24459 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 18:54:30.099205 24459 mini_ranger_kms.cc:401] 127.23.226.212:51679/kms/v1/keys
Aug 11 18:54:30 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474470, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.226.212@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
Aug 11 18:54:30 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474470, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.226.212@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
Aug 11 18:54:33 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:54:33.514993 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:40165
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:41439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:40165
--ranger_config_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:51679/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:33.630175 9422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:33.630462 9422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:33.630506 9422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:33.631811 9422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:54:33.631855 9422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:33.631868 9422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:33.631881 9422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:54:33.631893 9422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:54:33.633611 9422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/wal
--ranger_kms_url=127.23.226.212:51679/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:40165
--ranger_config_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:40165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:54:33.633879 9422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:33.634152 9422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:54:33.641006 9422 server_base.cc:1034] running on GCE node
W20260811 18:54:33.640966 9435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:33.641151 9438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:33.640973 9436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:33.641528 9422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:33.641830 9422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:33.643002 9422 hybrid_clock.cc:648] HybridClock initialized: now 1786474473642986 us; error 33 us; skew 500 ppm
Aug 11 18:54:33 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474473, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:33.650071 9422 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:54:33.650664 9422 webserver.cc:460] Webserver started at http://127.23.226.254:35175/ using document root <none> and password file <none>
I20260811 18:54:33.650925 9422 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:33.650990 9422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:33.651146 9422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:54:33 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474473, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:54:33.702587 9422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "b0a5fd0411db40039c412aec43105d42"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-68xk"
server_key: "164504b4da2bd5f204ac2d45ae3ecb83"
server_key_iv: "d6c69fe2bba5ca1a5588b79bb562a7f4"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:33.703075 9422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "b0a5fd0411db40039c412aec43105d42"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-68xk"
server_key: "164504b4da2bd5f204ac2d45ae3ecb83"
server_key_iv: "d6c69fe2bba5ca1a5588b79bb562a7f4"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:33.704787 9422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 18:54:33.717868 9448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:33.718132 9422 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:54:33.718262 9422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "b0a5fd0411db40039c412aec43105d42"
format_stamp: "Formatted at 2026-08-11 18:54:33 on dist-test-slave-68xk"
server_key: "164504b4da2bd5f204ac2d45ae3ecb83"
server_key_iv: "d6c69fe2bba5ca1a5588b79bb562a7f4"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:33.718386 9422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:33.736755 9422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:33.739107 9422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:33.739387 9422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:33.750710 9422 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:40165
I20260811 18:54:33.750813 9524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:40165 every 8 connection(s)
I20260811 18:54:33.751267 9422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:54:33.752351 9525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:33.753196 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 9422
I20260811 18:54:33.753299 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:54:33.753487 24459 external_mini_cluster.cc:1428] Setting key 3c6f2e9ef001ffd82e86076f8414e1a9
I20260811 18:54:33.756481 9525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42: Bootstrap starting.
I20260811 18:54:33.757766 9525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:33.758515 9525 log.cc:824] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:33.759845 9525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42: No bootstrap required, opened a new log
Aug 11 18:54:33 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:54:33.763499 9525 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a5fd0411db40039c412aec43105d42" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40165 } }
I20260811 18:54:33.763746 9525 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:33.763840 9525 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a5fd0411db40039c412aec43105d42, State: Initialized, Role: FOLLOWER
I20260811 18:54:33.764031 9525 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a5fd0411db40039c412aec43105d42" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40165 } }
I20260811 18:54:33.764156 9525 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:54:33.764218 9525 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:54:33.764297 9525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:33.765300 9525 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a5fd0411db40039c412aec43105d42" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40165 } }
I20260811 18:54:33.765435 9525 leader_election.cc:302] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0a5fd0411db40039c412aec43105d42; no voters:
I20260811 18:54:33.765620 9525 leader_election.cc:288] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:54:33.765715 9530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:33.766039 9525 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:54:33.766465 9530 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [term 1 LEADER]: Becoming Leader. State: Replica: b0a5fd0411db40039c412aec43105d42, State: Running, Role: LEADER
I20260811 18:54:33.766641 9530 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a5fd0411db40039c412aec43105d42" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40165 } }
I20260811 18:54:33.768990 9531 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0a5fd0411db40039c412aec43105d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a5fd0411db40039c412aec43105d42" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40165 } } }
I20260811 18:54:33.769071 9531 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:33.769085 9528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:33.754258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40428 (local address 127.23.226.254:40165)
0811 18:54:33.754617 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:33.754628 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:33.754702 (+ 74us) server_negotiation.cc:407] Connection header received
0811 18:54:33.755357 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:33.755367 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:33.755433 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:33.755627 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:33.756470 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.758281 (+ 1811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.759481 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:33.760211 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:33.760327 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:33.763577 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:33.763582 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:33.763582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:33.763596 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:33.766030 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:33.766466 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:33.766470 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:33.766470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:33.766637 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:33.767042 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:33.767042 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:33.767043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:33.767362 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:33.768063 (+ 701us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:33.768691 (+ 628us) server_negotiation.cc:299] Negotiation successful
0811 18:54:33.768828 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":156,"threads_started":1}
I20260811 18:54:33.769408 9533 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0a5fd0411db40039c412aec43105d42. Latest consensus state: current_term: 1 leader_uuid: "b0a5fd0411db40039c412aec43105d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0a5fd0411db40039c412aec43105d42" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 40165 } } }
I20260811 18:54:33.769506 9533 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42 [sys.catalog]: This master's current role is: LEADER
I20260811 18:54:33.769762 9548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:54:33.770087 9525 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 18:54:33.770553 9548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:54:33.781570 9548 catalog_manager.cc:1347] Generated new cluster ID: c677d6246c30471ca7eb8db6c76eabaa
I20260811 18:54:33.781894 9548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:54:33.798149 9548 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:54:33.799093 9548 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:54:33.804118 9548 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42: Generated new TSK 0
I20260811 18:54:33.804410 9548 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:54:34.806180 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:51679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40165
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:41439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:34.935392 9591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:34.935827 9591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:34.935889 9591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:34.937145 9591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:34.937232 9591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:34.937288 9591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:54:34.938942 9591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.23.226.212:51679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:54:34.939205 9591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:34.939469 9591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:34.946645 9598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:34.946669 9600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:34.946700 9597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:34.947407 9591 server_base.cc:1034] running on GCE node
I20260811 18:54:34.947623 9591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:34.947901 9591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:34.949071 9591 hybrid_clock.cc:648] HybridClock initialized: now 1786474474949046 us; error 43 us; skew 500 ppm
Aug 11 18:54:34 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:34.952342 9591 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:54:34.952859 9591 webserver.cc:460] Webserver started at http://127.23.226.193:41493/ using document root <none> and password file <none>
I20260811 18:54:34.953107 9591 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:34.953181 9591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:34.953318 9591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:54:34 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:54:34.967355 9591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4"
format_stamp: "Formatted at 2026-08-11 18:54:34 on dist-test-slave-68xk"
server_key: "f63eef231b3ebc7df412b042a8215f7e"
server_key_iv: "4698a6c1678ae92f2569284c7c6d0051"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:34.967993 9591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4"
format_stamp: "Formatted at 2026-08-11 18:54:34 on dist-test-slave-68xk"
server_key: "f63eef231b3ebc7df412b042a8215f7e"
server_key_iv: "4698a6c1678ae92f2569284c7c6d0051"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:34.972127 9591 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.001s
I20260811 18:54:34.986188 9611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:34.986384 9591 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 18:54:34.986521 9591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4"
format_stamp: "Formatted at 2026-08-11 18:54:34 on dist-test-slave-68xk"
server_key: "f63eef231b3ebc7df412b042a8215f7e"
server_key_iv: "4698a6c1678ae92f2569284c7c6d0051"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:34.986671 9591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:35.004877 9591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:35.007547 9591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:35.007663 9591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:35.007895 9591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:35.008378 9591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:35.008411 9591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:35.008435 9591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:35.008446 9591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:35.025274 9591 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:39953
I20260811 18:54:35.025842 9591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:54:35.034646 9771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:39953 every 8 connection(s)
I20260811 18:54:35.035457 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 9591
I20260811 18:54:35.035568 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:54:35.035780 24459 external_mini_cluster.cc:1428] Setting key dc14c50931149657de389a68820b7554
Aug 11 18:54:35 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474474, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:54:35.049235 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.035347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40165 (local address 127.23.226.193:54173)
0811 18:54:35.035992 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:35.036046 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:35.037046 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:35.037624 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:35.037630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:35.038024 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:35.038395 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.038402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.039456 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.039458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.041127 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.041130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.041753 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.041754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.041919 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.042606 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:35.042618 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:35.044729 (+ 2111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:35.047187 (+ 2458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:35.047195 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:35.047198 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:35.047545 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:35.047793 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:35.047794 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:35.047794 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:35.047939 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:35.048338 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:35.048354 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:35.048584 (+ 230us) client_negotiation.cc:769] Sending connection context
0811 18:54:35.048714 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 18:54:35.048885 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":187,"threads_started":1}
I20260811 18:54:35.049856 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.035781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:54173 (local address 127.23.226.254:40165)
0811 18:54:35.037234 (+ 1453us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.037236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.037244 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:54:35.037269 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.037270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.037282 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.037347 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:35.038545 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.039340 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.041257 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.041596 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.041672 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.044908 (+ 3236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:35.044910 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:35.044910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:35.044918 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:35.047082 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:35.047642 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:35.047643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:35.047644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:35.047713 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:35.048018 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:35.048019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:35.048020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:35.048180 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:35.048297 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.049646 (+ 1349us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.049743 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1428,"thread_start_us":66,"threads_started":1}
I20260811 18:54:35.050833 9774 heartbeater.cc:347] Connected to a master server at 127.23.226.254:40165
I20260811 18:54:35.050956 9774 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:35.051162 9774 heartbeater.cc:511] Master 127.23.226.254:40165 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
I20260811 18:54:35.051919 9473 ts_manager.cc:194] Registered new tserver with Master: 6f6f38ea5598468e8a45f2c7ac28cdc4 (127.23.226.193:39953)
I20260811 18:54:35.052860 9473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:54173
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:54:35.078171 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:51679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40165
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:41439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:35.252775 9787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:35.253077 9787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:35.253118 9787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:35.254908 9787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:35.254974 9787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:35.255021 9787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:54:35.257450 9787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.23.226.212:51679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:54:35.257757 9787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:35.258038 9787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:35.267022 9799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:35.267325 9800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:35.267957 9787 server_base.cc:1034] running on GCE node
W20260811 18:54:35.268220 9803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:35.268597 9787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:35.268867 9787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:35.272138 9787 hybrid_clock.cc:648] HybridClock initialized: now 1786474475272117 us; error 42 us; skew 500 ppm
Aug 11 18:54:35 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474475, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:35.276189 9787 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:54:35.276789 9787 webserver.cc:460] Webserver started at http://127.23.226.194:45183/ using document root <none> and password file <none>
I20260811 18:54:35.277109 9787 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:35.277227 9787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:35.277401 9787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:54:35 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474475, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:54:35.292153 9787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "4dbd40621a494c57bfd1065ed8489309"
format_stamp: "Formatted at 2026-08-11 18:54:35 on dist-test-slave-68xk"
server_key: "5f03deeb95ff80181819ccf14d6cf27e"
server_key_iv: "448baafe6115cebda15db389a986bae9"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:35.293012 9787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "4dbd40621a494c57bfd1065ed8489309"
format_stamp: "Formatted at 2026-08-11 18:54:35 on dist-test-slave-68xk"
server_key: "5f03deeb95ff80181819ccf14d6cf27e"
server_key_iv: "448baafe6115cebda15db389a986bae9"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:35.296558 9787 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 18:54:35.314651 9813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:35.314927 9787 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 18:54:35.315023 9787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "4dbd40621a494c57bfd1065ed8489309"
format_stamp: "Formatted at 2026-08-11 18:54:35 on dist-test-slave-68xk"
server_key: "5f03deeb95ff80181819ccf14d6cf27e"
server_key_iv: "448baafe6115cebda15db389a986bae9"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:35.315115 9787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:35.345521 9787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:35.348337 9787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:35.348572 9787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:35.348949 9787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:35.349730 9787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:35.349828 9787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:35.349906 9787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:35.349964 9787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:35.370898 9787 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:33943
I20260811 18:54:35.371711 9787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:54:35 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474475, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:35.374554 9971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:33943 every 8 connection(s)
I20260811 18:54:35.379297 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 9787
I20260811 18:54:35.379417 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:54:35.379608 24459 external_mini_cluster.cc:1428] Setting key 7529f4c1bfd5aa323233e6db6746d854
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Aug 11 18:54:35 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474475, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:54:35.406545 9974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.375493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40165 (local address 127.23.226.194:34059)
0811 18:54:35.375728 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:35.375786 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:35.376651 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:35.377051 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:35.377055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:35.377540 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:35.377944 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.377952 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.379962 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.379963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.384640 (+ 4677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.384643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.390846 (+ 6203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.390848 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.391053 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.395871 (+ 4818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:35.395889 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:35.402399 (+ 6510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:35.404672 (+ 2273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:35.404684 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:35.404688 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:35.405029 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:35.405279 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:35.405280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:35.405280 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:35.405431 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:35.405746 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:35.405754 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:35.405941 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 18:54:35.406065 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 18:54:35.406257 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":119,"threads_started":1}
I20260811 18:54:35.407130 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.375486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:34059 (local address 127.23.226.254:40165)
0811 18:54:35.375544 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.375547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.375896 (+ 349us) server_negotiation.cc:407] Connection header received
0811 18:54:35.376795 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.376797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.376815 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.376850 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:35.378081 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.379018 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.386331 (+ 7313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.386670 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.386754 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.402605 (+ 15851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:35.402607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:35.402608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:35.402619 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:35.404545 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:35.405145 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:35.405146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:35.405147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:35.405209 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:35.405502 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:35.405503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:35.405503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:35.405652 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:35.405717 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.406966 (+ 1249us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.407066 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
I20260811 18:54:35.407647 9972 heartbeater.cc:347] Connected to a master server at 127.23.226.254:40165
I20260811 18:54:35.407748 9972 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:35.407950 9972 heartbeater.cc:511] Master 127.23.226.254:40165 requested a full tablet report, sending...
I20260811 18:54:35.409716 9473 ts_manager.cc:194] Registered new tserver with Master: 4dbd40621a494c57bfd1065ed8489309 (127.23.226.194:33943)
I20260811 18:54:35.410365 9473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:34059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:54:35.429750 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:51679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40165
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:41439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:54:35.607506 9979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:54:35.607861 9979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:54:35.607911 9979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:54:35.609839 9979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:54:35.609896 9979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:54:35.609935 9979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:54:35.612509 9979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.23.226.212:51679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:40165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:54:35.612824 9979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:54:35.613183 9979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:54:35.621873 9987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:35.622114 9991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:54:35.622768 9988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:54:35.623064 9979 server_base.cc:1034] running on GCE node
I20260811 18:54:35.623281 9979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:54:35.623541 9979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:54:35.624720 9979 hybrid_clock.cc:648] HybridClock initialized: now 1786474475624698 us; error 41 us; skew 500 ppm
Aug 11 18:54:35 dist-test-slave-68xk krb5kdc[8778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474475, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:54:35.629272 9979 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:54:35.629994 9979 webserver.cc:460] Webserver started at http://127.23.226.195:37245/ using document root <none> and password file <none>
I20260811 18:54:35.630373 9979 fs_manager.cc:359] Metadata directory not provided
I20260811 18:54:35.630483 9979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:54:35.630710 9979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:54:35 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474475, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:54:35.651214 9979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "66ab2760c68440bbb68cae02725fa1cb"
format_stamp: "Formatted at 2026-08-11 18:54:35 on dist-test-slave-68xk"
server_key: "1369b13d82a00f543ba71ab55abbd20a"
server_key_iv: "a75dd9d1eadd67062a81a5a8184a32a2"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:35.651665 9979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "66ab2760c68440bbb68cae02725fa1cb"
format_stamp: "Formatted at 2026-08-11 18:54:35 on dist-test-slave-68xk"
server_key: "1369b13d82a00f543ba71ab55abbd20a"
server_key_iv: "a75dd9d1eadd67062a81a5a8184a32a2"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:35.653365 9979 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:54:35.666596 10003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:35.666802 9979 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:54:35.666929 9979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "66ab2760c68440bbb68cae02725fa1cb"
format_stamp: "Formatted at 2026-08-11 18:54:35 on dist-test-slave-68xk"
server_key: "1369b13d82a00f543ba71ab55abbd20a"
server_key_iv: "a75dd9d1eadd67062a81a5a8184a32a2"
server_key_version: "kuduclusterkey@0"
I20260811 18:54:35.667037 9979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:54:35.677435 9979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:54:35.679760 9979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:54:35.679941 9979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:54:35.680246 9979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:54:35.680712 9979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:54:35.680791 9979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:35.680826 9979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:54:35.680852 9979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:54:35.696163 9979 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:42445
I20260811 18:54:35.696682 9979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:54:35.698583 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 9979
I20260811 18:54:35.698715 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:54:35.698973 24459 external_mini_cluster.cc:1428] Setting key 39439b17a88a257e118d309f7091f820
I20260811 18:54:35.699599 10166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:42445 every 8 connection(s)
Aug 11 18:54:35 dist-test-slave-68xk krb5kdc[8778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474475, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:54:35.714087 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.701206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:46857 (local address 127.23.226.254:40165)
0811 18:54:35.701253 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.701255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.701407 (+ 152us) server_negotiation.cc:407] Connection header received
0811 18:54:35.702291 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.702292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.702304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.702367 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:35.703610 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.704444 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.706278 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.706674 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.706768 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.710467 (+ 3699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:35.710469 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:35.710469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:35.710478 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:35.712336 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:35.712868 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:35.712870 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:35.712870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:35.712937 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:35.713269 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:35.713270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:35.713270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:35.713418 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:35.713466 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.713874 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.713973 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:54:35.715035 10170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.700831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:40165 (local address 127.23.226.195:46857)
0811 18:54:35.701203 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:35.701267 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:35.702174 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:35.702471 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:35.702476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:35.702915 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:54:35.703450 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.703457 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.704585 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.704586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.706156 (+ 1570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.706160 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.706802 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.706804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.706984 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.707766 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:54:35.707777 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:54:35.710087 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:54:35.712447 (+ 2360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:35.712454 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:35.712457 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:35.712771 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:35.713014 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:54:35.713015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:54:35.713015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:54:35.713167 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:54:35.713519 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:54:35.713526 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:54:35.713701 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 18:54:35.714461 (+ 760us) client_negotiation.cc:240] Negotiation successful
0811 18:54:35.714640 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":173,"threads_started":1}
I20260811 18:54:35.716308 10167 heartbeater.cc:347] Connected to a master server at 127.23.226.254:40165
I20260811 18:54:35.716467 10167 heartbeater.cc:464] Registering TS with master...
I20260811 18:54:35.716733 10167 heartbeater.cc:511] Master 127.23.226.254:40165 requested a full tablet report, sending...
I20260811 18:54:35.717211 9473 ts_manager.cc:194] Registered new tserver with Master: 66ab2760c68440bbb68cae02725fa1cb (127.23.226.195:42445)
I20260811 18:54:35.717788 9473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:46857
I20260811 18:54:35.726020 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:54:35.740819 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.730711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40436 (local address 127.23.226.254:40165)
0811 18:54:35.730771 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.730774 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.731226 (+ 452us) server_negotiation.cc:407] Connection header received
0811 18:54:35.731344 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.731345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.731358 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.731404 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:54:35.732447 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.733288 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.734588 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.734947 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.735016 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.737031 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:54:35.737033 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:54:35.737033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:54:35.737052 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:54:35.739333 (+ 2281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:35.739819 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:35.739820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:35.739821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:35.739898 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:54:35.740185 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:54:35.740186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:54:35.740187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:54:35.740341 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:54:35.740461 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.740622 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.740714 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:54:35.743355 9473 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:54:35.746495 9473 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:54:35.770874 10182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.751065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:42445 (local address 127.0.0.1:48022)
0811 18:54:35.753646 (+ 2581us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:35.753713 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:35.753793 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:35.757825 (+ 4032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:35.757826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:35.757828 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:35.757904 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.757906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.759989 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.759990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.767655 (+ 7665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.767659 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.770386 (+ 2727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.770387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.770518 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.770570 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 18:54:35.770677 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 18:54:35.770759 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2536,"thread_start_us":189,"threads_started":1}
I20260811 18:54:35.775615 10186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.751462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39953 (local address 127.0.0.1:33742)
0811 18:54:35.754731 (+ 3269us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:35.754743 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:35.754814 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:35.755681 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:35.755685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:35.755687 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:35.755765 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.755783 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.765779 (+ 9996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.765780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.767192 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.767196 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.775370 (+ 8174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.775371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.775437 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.775441 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:54:35.775494 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:54:35.775536 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3221,"thread_start_us":147,"threads_started":1}
I20260811 18:54:35.774554 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.752525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:33943 (local address 127.0.0.1:59752)
0811 18:54:35.755941 (+ 3416us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:35.755952 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:35.756006 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:35.757992 (+ 1986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:35.757992 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:35.757994 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:35.758025 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.758027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.762097 (+ 4070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.762099 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.763835 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.763838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.774187 (+ 10349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.774188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.774270 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.774275 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:54:35.774349 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 18:54:35.774440 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3392,"thread_start_us":93,"threads_started":1}
I20260811 18:54:35.776539 10184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.752212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33742 (local address 127.23.226.193:39953)
0811 18:54:35.754597 (+ 2385us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.754603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.755072 (+ 469us) server_negotiation.cc:407] Connection header received
0811 18:54:35.755452 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.755455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.755474 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.755565 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:35.756419 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.765661 (+ 9242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.767804 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.775148 (+ 7344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.775250 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.775326 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.776353 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.776404 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2347,"thread_start_us":75,"threads_started":1}
I20260811 18:54:35.777148 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.751958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48022 (local address 127.23.226.195:42445)
0811 18:54:35.754123 (+ 2165us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.754129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.754142 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:54:35.754232 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.754234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.754255 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.754374 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:35.758498 (+ 4124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.759872 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.768882 (+ 9010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.770073 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.776830 (+ 6757us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.776914 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.776949 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.777003 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2082,"thread_start_us":145,"threads_started":1}
I20260811 18:54:35.778223 9659 tablet_service.cc:1467] Processing CreateTablet for tablet aba917dbf678456784de3b2d11629e8d (DEFAULT_TABLE table=test-table [id=d9ab79ef80234f45abfb05a9f8839bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:35.778764 9659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aba917dbf678456784de3b2d11629e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:35.782354 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.753043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59752 (local address 127.23.226.194:33943)
0811 18:54:35.755037 (+ 1994us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.755042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.756074 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 18:54:35.756166 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.756168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.756187 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.756273 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:35.758114 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.761963 (+ 3849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.771570 (+ 9607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.772743 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.772972 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.773064 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.782125 (+ 9061us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.782186 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1939,"thread_start_us":174,"threads_started":1}
I20260811 18:54:35.783437 9880 tablet_service.cc:1467] Processing CreateTablet for tablet aba917dbf678456784de3b2d11629e8d (DEFAULT_TABLE table=test-table [id=d9ab79ef80234f45abfb05a9f8839bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:35.783463 10058 tablet_service.cc:1467] Processing CreateTablet for tablet aba917dbf678456784de3b2d11629e8d (DEFAULT_TABLE table=test-table [id=d9ab79ef80234f45abfb05a9f8839bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:54:35.783875 10058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aba917dbf678456784de3b2d11629e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:35.783880 9880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aba917dbf678456784de3b2d11629e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:54:35.790905 10192 tablet_bootstrap.cc:492] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4: Bootstrap starting.
I20260811 18:54:35.791280 10188 tablet_bootstrap.cc:492] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Bootstrap starting.
I20260811 18:54:35.792743 10192 tablet_bootstrap.cc:654] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:35.793015 10188 tablet_bootstrap.cc:654] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:35.793717 10188 log.cc:824] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:35.793704 10192 log.cc:824] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:35.794253 10190 tablet_bootstrap.cc:492] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Bootstrap starting.
I20260811 18:54:35.794973 10188 tablet_bootstrap.cc:492] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: No bootstrap required, opened a new log
I20260811 18:54:35.795073 10188 ts_tablet_manager.cc:1397] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 18:54:35.796365 10190 tablet_bootstrap.cc:654] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Neither blocks nor log segments found. Creating new log.
I20260811 18:54:35.797379 10190 log.cc:824] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Log is configured to *not* fsync() on all Append() calls
I20260811 18:54:35.798491 10192 tablet_bootstrap.cc:492] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4: No bootstrap required, opened a new log
I20260811 18:54:35.798622 10192 ts_tablet_manager.cc:1397] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260811 18:54:35.799319 10188 raft_consensus.cc:348] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.800204 10188 raft_consensus.cc:374] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:35.800307 10188 raft_consensus.cc:729] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ab2760c68440bbb68cae02725fa1cb, State: Initialized, Role: FOLLOWER
I20260811 18:54:35.800601 10188 consensus_queue.cc:260] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.801102 10188 ts_tablet_manager.cc:1428] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 18:54:35.801290 10167 heartbeater.cc:503] Master 127.23.226.254:40165 was elected leader, sending a full tablet report...
I20260811 18:54:35.803339 10190 tablet_bootstrap.cc:492] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: No bootstrap required, opened a new log
I20260811 18:54:35.803421 10190 ts_tablet_manager.cc:1397] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260811 18:54:35.806850 10190 raft_consensus.cc:348] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.807029 10190 raft_consensus.cc:374] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:35.807065 10190 raft_consensus.cc:729] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbd40621a494c57bfd1065ed8489309, State: Initialized, Role: FOLLOWER
I20260811 18:54:35.808017 10190 consensus_queue.cc:260] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.808009 10192 raft_consensus.cc:348] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.808167 10192 raft_consensus.cc:374] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:54:35.808256 10192 raft_consensus.cc:729] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6f38ea5598468e8a45f2c7ac28cdc4, State: Initialized, Role: FOLLOWER
I20260811 18:54:35.808457 10192 consensus_queue.cc:260] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.808676 10190 ts_tablet_manager.cc:1428] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260811 18:54:35.808844 9972 heartbeater.cc:503] Master 127.23.226.254:40165 was elected leader, sending a full tablet report...
I20260811 18:54:35.809113 9774 heartbeater.cc:503] Master 127.23.226.254:40165 was elected leader, sending a full tablet report...
I20260811 18:54:35.809271 10192 ts_tablet_manager.cc:1428] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4: Time spent starting tablet: real 0.011s user 0.001s sys 0.005s
W20260811 18:54:35.876489 9973 tablet.cc:2369] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:35.948040 10202 raft_consensus.cc:482] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:54:35.948271 10202 raft_consensus.cc:504] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.948781 10202 leader_election.cc:288] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbd40621a494c57bfd1065ed8489309 (127.23.226.194:33943), 66ab2760c68440bbb68cae02725fa1cb (127.23.226.195:42445)
W20260811 18:54:35.951014 10168 tablet.cc:2369] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:54:35.963542 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.949150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:34241 (local address 127.23.226.195:42445)
0811 18:54:35.949232 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.949234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.952975 (+ 3741us) server_negotiation.cc:407] Connection header received
0811 18:54:35.953110 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.953112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.953124 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.953158 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:35.953638 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.954686 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.957216 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.957935 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.957996 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.958009 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.963394 (+ 5385us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.963454 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:54:35.963884 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.949087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:42445 (local address 127.23.226.193:34241)
0811 18:54:35.952874 (+ 3787us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:35.952890 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:35.953016 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:35.953252 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:35.953253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:35.953325 (+ 72us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:35.953518 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.953522 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.955378 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.955379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.957085 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.957089 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.959348 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.959349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.959486 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.959493 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:54:35.963712 (+ 4219us) client_negotiation.cc:240] Negotiation successful
0811 18:54:35.963767 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3732,"thread_start_us":169,"threads_started":1}
I20260811 18:54:35.964607 10102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aba917dbf678456784de3b2d11629e8d" candidate_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ab2760c68440bbb68cae02725fa1cb" is_pre_election: true
I20260811 18:54:35.964804 10102 raft_consensus.cc:2454] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6f38ea5598468e8a45f2c7ac28cdc4 in term 0.
I20260811 18:54:35.965132 9612 leader_election.cc:302] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66ab2760c68440bbb68cae02725fa1cb, 6f6f38ea5598468e8a45f2c7ac28cdc4; no voters:
I20260811 18:54:35.965329 10202 raft_consensus.cc:2781] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:54:35.965376 10202 raft_consensus.cc:482] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:54:35.965400 10202 raft_consensus.cc:3037] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:35.966851 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.949514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:52769 (local address 127.23.226.194:33943)
0811 18:54:35.949579 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.949581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.962666 (+ 13085us) server_negotiation.cc:407] Connection header received
0811 18:54:35.962798 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.962800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.962814 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.962849 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:54:35.963225 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.963958 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.965667 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.966316 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.966393 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.966404 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.966704 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.966748 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:54:35.966995 10202 raft_consensus.cc:504] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.967200 10202 leader_election.cc:288] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbd40621a494c57bfd1065ed8489309 (127.23.226.194:33943), 66ab2760c68440bbb68cae02725fa1cb (127.23.226.195:42445)
I20260811 18:54:35.967248 10206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.949425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:33943 (local address 127.23.226.193:52769)
0811 18:54:35.962560 (+ 13135us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:35.962585 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 18:54:35.962706 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:54:35.962924 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:54:35.962925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:54:35.962927 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:54:35.963112 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.963114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.964078 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.964079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.965521 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:54:35.965523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.966496 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.966497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:54:35.966605 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.966610 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:54:35.966978 (+ 368us) client_negotiation.cc:240] Negotiation successful
0811 18:54:35.967027 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13101,"thread_start_us":169,"threads_started":1}
I20260811 18:54:35.967607 9908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aba917dbf678456784de3b2d11629e8d" candidate_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbd40621a494c57bfd1065ed8489309" is_pre_election: true
I20260811 18:54:35.967796 9908 raft_consensus.cc:2454] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6f38ea5598468e8a45f2c7ac28cdc4 in term 0.
I20260811 18:54:35.967916 9907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aba917dbf678456784de3b2d11629e8d" candidate_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbd40621a494c57bfd1065ed8489309"
I20260811 18:54:35.967967 9907 raft_consensus.cc:3037] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:35.968298 10102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aba917dbf678456784de3b2d11629e8d" candidate_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66ab2760c68440bbb68cae02725fa1cb"
I20260811 18:54:35.968413 10102 raft_consensus.cc:3037] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:54:35.968813 9907 raft_consensus.cc:2454] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6f38ea5598468e8a45f2c7ac28cdc4 in term 1.
I20260811 18:54:35.969691 10102 raft_consensus.cc:2454] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6f38ea5598468e8a45f2c7ac28cdc4 in term 1.
I20260811 18:54:35.970009 9617 leader_election.cc:302] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbd40621a494c57bfd1065ed8489309, 6f6f38ea5598468e8a45f2c7ac28cdc4; no voters:
I20260811 18:54:35.970252 10202 raft_consensus.cc:2781] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:54:35.970463 10202 raft_consensus.cc:686] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6f38ea5598468e8a45f2c7ac28cdc4, State: Running, Role: LEADER
I20260811 18:54:35.970569 10202 consensus_queue.cc:237] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } }
I20260811 18:54:35.971675 9473 catalog_manager.cc:5495] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6f38ea5598468e8a45f2c7ac28cdc4 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f6f38ea5598468e8a45f2c7ac28cdc4" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39953 } health_report { overall_health: HEALTHY } } }
I20260811 18:54:35.989487 10184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:35.985542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33746 (local address 127.23.226.193:39953)
0811 18:54:35.985609 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 18:54:35.985611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:54:35.985624 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:54:35.985666 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:54:35.985667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:54:35.985694 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:54:35.985794 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:54:35.985978 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.986827 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.988123 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:54:35.988464 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:54:35.988535 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:54:35.988754 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:54:35.988898 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:54:35.988985 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 18:54:35.989251 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 18:54:35.989274 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:54:35.993750 10102 raft_consensus.cc:1261] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6f38ea5598468e8a45f2c7ac28cdc4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:35.994346 10207 consensus_queue.cc:1035] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66ab2760c68440bbb68cae02725fa1cb" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 42445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:35.996636 9907 raft_consensus.cc:1261] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 1 FOLLOWER]: Refusing update from remote peer 6f6f38ea5598468e8a45f2c7ac28cdc4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:54:35.997044 10207 consensus_queue.cc:1035] T aba917dbf678456784de3b2d11629e8d P 6f6f38ea5598468e8a45f2c7ac28cdc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbd40621a494c57bfd1065ed8489309" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:54:36.002005 10215 mvcc.cc:205] Tried to move back new op lower bound from 7317399453666803712 to 7317399453576355840. Current Snapshot: MvccSnapshot[applied={T|T < 7317399453666803712}]
I20260811 18:54:36.002810 10218 mvcc.cc:205] Tried to move back new op lower bound from 7317399453666803712 to 7317399453576355840. Current Snapshot: MvccSnapshot[applied={T|T < 7317399453666803712}]
I20260811 18:54:36.009286 9473 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:36.009409 9473 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:54:36.010136 9473 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0a5fd0411db40039c412aec43105d42: Sending DeleteTablet for 3 replicas of tablet aba917dbf678456784de3b2d11629e8d
I20260811 18:54:36.010387 10216 mvcc.cc:205] Tried to move back new op lower bound from 7317399453666803712 to 7317399453576355840. Current Snapshot: MvccSnapshot[applied={T|T < 7317399453666803712}]
I20260811 18:54:36.010768 9659 tablet_service.cc:1514] Processing DeleteTablet for tablet aba917dbf678456784de3b2d11629e8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:36 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:33742
I20260811 18:54:36.010851 10058 tablet_service.cc:1514] Processing DeleteTablet for tablet aba917dbf678456784de3b2d11629e8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:36 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:48022
I20260811 18:54:36.011325 9880 tablet_service.cc:1514] Processing DeleteTablet for tablet aba917dbf678456784de3b2d11629e8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:54:36 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:59752
I20260811 18:54:36.011935 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 9591
I20260811 18:54:36.021596 10230 tablet_replica.cc:330] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: stopping tablet replica
I20260811 18:54:36.021742 10233 tablet_replica.cc:330] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: stopping tablet replica
I20260811 18:54:36.021869 10233 raft_consensus.cc:2229] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:36.021968 10230 raft_consensus.cc:2229] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:54:36.022009 10233 raft_consensus.cc:2258] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:36.022248 10230 raft_consensus.cc:2258] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:54:36.022581 10233 ts_tablet_manager.cc:1905] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:36.022878 10230 ts_tablet_manager.cc:1905] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:54:36.026252 10233 ts_tablet_manager.cc:1918] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:36.026345 10233 log.cc:1196] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/aba917dbf678456784de3b2d11629e8d
I20260811 18:54:36.026659 10233 ts_tablet_manager.cc:1939] T aba917dbf678456784de3b2d11629e8d P 4dbd40621a494c57bfd1065ed8489309: Deleting consensus metadata
I20260811 18:54:36.030570 10230 ts_tablet_manager.cc:1918] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:54:36.030606 9454 catalog_manager.cc:4841] TS 4dbd40621a494c57bfd1065ed8489309 (127.23.226.194:33943): tablet aba917dbf678456784de3b2d11629e8d (table test-table [id=d9ab79ef80234f45abfb05a9f8839bce]) successfully deleted
I20260811 18:54:36.030676 10230 log.cc:1196] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/aba917dbf678456784de3b2d11629e8d
I20260811 18:54:36.031337 10230 ts_tablet_manager.cc:1939] T aba917dbf678456784de3b2d11629e8d P 66ab2760c68440bbb68cae02725fa1cb: Deleting consensus metadata
I20260811 18:54:36.031901 9450 catalog_manager.cc:4841] TS 66ab2760c68440bbb68cae02725fa1cb (127.23.226.195:42445): tablet aba917dbf678456784de3b2d11629e8d (table test-table [id=d9ab79ef80234f45abfb05a9f8839bce]) successfully deleted
W20260811 18:54:36.032444 9452 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:39953 (error 108)
I20260811 18:54:36.032809 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 9787
I20260811 18:54:36.044930 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 9979
I20260811 18:54:36.052698 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 9422
I20260811 18:54:36.052907 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:54:36.052716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39953 (local address 127.0.0.1:33756)
0811 18:54:36.052804 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 18:54:36.052858 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:39953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 18:54:36.068629 24459 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 18:54:36.413604 24459 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 18:54:36.413719 24459 mini_ranger.cc:66] Stopping Ranger...
I20260811 18:54:36.769627 24459 mini_ranger.cc:68] Stopped Ranger
2026-08-11 18:54:36.769 UTC [8826] LOG: received smart shutdown request
2026-08-11 18:54:36.774 UTC [8826] LOG: background worker "logical replication launcher" (PID 8839) exited with exit code 1
2026-08-11 18:54:36.775 UTC [8831] LOG: shutting down
2026-08-11 18:54:36.988 UTC [8826] LOG: database system is shut down
2026-08-11T18:54:36Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49678 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:54:37 dist-test-slave-68xk krb5kdc[10247](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:54:37 dist-test-slave-68xk krb5kdc[10247](info): set up 2 sockets
Aug 11 18:54:37 dist-test-slave-68xk krb5kdc[10247](info): commencing operation
krb5kdc: starting...
W20260811 18:54:38.467586 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:54:38 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:54:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:54:38Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.23.226.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.23.226.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/rangeradmin_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/rangeradmin_127.23.226.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.23.226.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.23.226.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/rangerlookup_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/rangerlookup_127.23.226.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.226.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.23.226.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/HTTP_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/HTTP_127.23.226.212@KRBTEST.COM.keytab.
I20260811 18:54:38.649478 24459 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskMIbuVm/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/postgres -l logfile start
2026-08-11 18:54:41.414 UTC [10284] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 18:54:41.414 UTC [10284] LOG: listening on IPv4 address "127.23.226.212", port 44033
2026-08-11 18:54:41.418 UTC [10284] LOG: listening on Unix socket "/tmp/.s.PGSQL.44033"
2026-08-11 18:54:41.442 UTC [10290] LOG: database system was shut down at 2026-08-11 18:54:39 UTC
2026-08-11 18:54:41.446 UTC [10284] LOG: database system is ready to accept connections
I20260811 18:54:42.666059 24459 mini_postgres.cc:96] Postgres bound to 44033
2026-08-11 18:54:42.673 UTC [10302] FATAL: database "slave" does not exist
127.23.226.212:44033 - accepting connections
I20260811 18:54:42.674129 24459 mini_ranger.cc:161] Starting Ranger...
I20260811 18:54:42.690752 24459 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 18:54:43.270036 24459 mini_ranger.cc:87] Created ranger Postgres database
I20260811 18:54:43.270134 24459 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-admin
2026-08-11 18:54:43,565 [I] DB FLAVOR :POSTGRES
2026-08-11 18:54:43,566 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:54:43,566 [I] Checking connection..
2026-08-11 18:54:43,566 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 18:54:43,822 [I] Checking connection passed.
2026-08-11 18:54:43,823 [I] --------- Verifying version history table ---------
2026-08-11 18:54:43,823 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:54:44,103 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:54:44,104 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:54:44,396 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 18:54:44,397 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 18:54:44,397 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 18:54:44.647 UTC [10401] WARNING: there is no transaction in progress
2026-08-11 18:54:44,657 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 18:54:44,658 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 18:54:44,925 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 18:54:44,925 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:54:44,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 18:54:45,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 18:54:45,475 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-68xk.c.gcp-upstream.internal','N') ;"
2026-08-11 18:54:45,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:54:45,966 [I] Table x_portal_user does not exist in database ranger
2026-08-11 18:54:45,966 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:54:46,221 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 18:54:46,221 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:54:46,475 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:54:46,744 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 18:54:46,745 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 18:54:47.810 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.828 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.846 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.863 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.879 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.896 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.951 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.959 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.974 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.985 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:47.996 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:48.013 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:48.023 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:48.030 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:48.038 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:48.046 UTC [10565] WARNING: there is no transaction in progress
2026-08-11 18:54:48,733 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 18:54:48,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 18:54:49,014 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 18:54:49,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 18:54:49,262 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 18:54:49,263 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 18:54:49,514 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 18:54:49,514 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 18:54:49,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 18:54:50,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-68xk.c.gcp-upstream.internal';"
2026-08-11 18:54:50,275 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 18:54:50,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 18:54:50,525 [I] DB_PATCHES have already been applied
I20260811 18:54:50.531673 24459 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-admin:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskMIbuVm/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 18:54:50.531760 24459 mini_ranger.cc:193] Using host: 127.23.226.212
I20260811 18:54:50.535686 24459 mini_ranger.cc:227] Ranger admin URL: http://127.23.226.212:40247
Aug 11, 2026 6:54:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:54:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:54:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 6:54:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 6:54:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 6:54:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 6:54:51 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 18:54:51.899742 24459 mini_ranger.cc:160] Time spent starting Ranger: real 9.226s user 0.000s sys 0.011s
Aug 11, 2026 6:55:12 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 6:55:12 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 6:55:12 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 6:55:12 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 6:55:13 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 18:55:14.146082 24459 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.23.226.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.23.226.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/rangerkms_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.23.226.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/rangerkms_127.23.226.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.23.226.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.23.226.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.23.226.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/HTTP_127.23.226.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.23.226.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/HTTP_127.23.226.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 18:55:14 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474514, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 18:55:14.255769 24459 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 18:55:14.266453 24459 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 18:55:15.221398 24459 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 18:55:15.221478 24459 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms
I20260811 18:55:15.221493 24459 mini_ranger_kms.cc:227] Using postgres at 127.23.226.212:44033
2026-08-11 18:55:15,404 [I] DB FLAVOR :POSTGRES
2026-08-11 18:55:15,405 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 18:55:15,405 [I] Checking connection
2026-08-11 18:55:15,405 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 18:55:15,648 [I] connection success
2026-08-11 18:55:15,648 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 18:55:15,649 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 18:55:15,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 18:55:15,884 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 18:55:15,885 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 18:55:15,885 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 18:55:15,885 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.23.226.212:44033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 18:55:16,169 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 18:55:16.691742 24459 mini_ranger_kms.cc:310] Created kms service
I20260811 18:55:16.866899 24459 mini_ranger_kms.cc:326] Created kudu user
I20260811 18:55:16.916501 24459 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 18:55:16 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474514, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:17.342528 24459 mini_ranger_kms.cc:384] Added ranger policy
I20260811 18:55:17.342754 24459 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms:/tmp/dist-test-taskMIbuVm/build/release/bin/postgresql.jar:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskMIbuVm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 18:55:17.342779 24459 mini_ranger_kms.cc:240] Using host: 127.23.226.212
I20260811 18:55:17.347158 24459 mini_ranger_kms.cc:276] Ranger KMS PID: 10836
I20260811 18:55:17.347242 24459 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.23.226.212:53495
Aug 11, 2026 6:55:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 6:55:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 6:55:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 6:55:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 6:55:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 6:55:19 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 18:55:19 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474519, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.226.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:20.070580 24459 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.815s user 0.005s sys 0.161s
I20260811 18:55:20.070708 24459 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 18:55:20.070780 24459 mini_ranger_kms.cc:401] 127.23.226.212:53495/kms/v1/keys
Aug 11 18:55:20 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474519, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.226.212@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
Aug 11 18:55:20 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474519, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.23.226.212@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
Aug 11 18:55:22 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:55:23.010397 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37939
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:37939
--ranger_config_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:53495/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:23.095919 10904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:23.096141 10904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:23.096164 10904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:23.097410 10904 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:23.097455 10904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:23.097470 10904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:23.097482 10904 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:23.097494 10904 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:23.099227 10904 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
--ranger_kms_url=127.23.226.212:53495/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:37939
--ranger_config_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:23.099490 10904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:23.099750 10904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:23.104914 10909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:23.104929 10911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:23.104929 10913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:23.105170 10904 server_base.cc:1034] running on GCE node
I20260811 18:55:23.105470 10904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:23.105762 10904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:23.106922 10904 hybrid_clock.cc:648] HybridClock initialized: now 1786474523106900 us; error 43 us; skew 500 ppm
Aug 11 18:55:23 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474523, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:23.114542 10904 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:55:23.115015 10904 webserver.cc:460] Webserver started at http://127.23.226.254:35331/ using document root <none> and password file <none>
I20260811 18:55:23.115232 10904 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:23.115274 10904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:23.115375 10904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:55:23 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474523, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:23.173118 10904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "19233bbacc1941bb89ea05f3687d430c"
format_stamp: "Formatted at 2026-08-11 18:55:23 on dist-test-slave-68xk"
server_key: "b32fb6970ec453765013ffe000333fe7"
server_key_iv: "8f8a552d2e6d288e31b45a166f70cdfa"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:23.173688 10904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "19233bbacc1941bb89ea05f3687d430c"
format_stamp: "Formatted at 2026-08-11 18:55:23 on dist-test-slave-68xk"
server_key: "b32fb6970ec453765013ffe000333fe7"
server_key_iv: "8f8a552d2e6d288e31b45a166f70cdfa"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:23.176004 10904 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 18:55:23.192641 10921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:23.192903 10904 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:23.193024 10904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "19233bbacc1941bb89ea05f3687d430c"
format_stamp: "Formatted at 2026-08-11 18:55:23 on dist-test-slave-68xk"
server_key: "b32fb6970ec453765013ffe000333fe7"
server_key_iv: "8f8a552d2e6d288e31b45a166f70cdfa"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:23.193156 10904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:23.213508 10904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:23.215662 10904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:23.215847 10904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:23.220333 10904 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:37939
I20260811 18:55:23.220395 11001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:37939 every 8 connection(s)
I20260811 18:55:23.220742 10904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:23.221427 11002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:23.223711 11002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Bootstrap starting.
I20260811 18:55:23.224242 11002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:23.224478 11002 log.cc:824] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:23.225152 11002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: No bootstrap required, opened a new log
I20260811 18:55:23.227202 11002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } }
I20260811 18:55:23.227344 11002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:23.227367 11002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19233bbacc1941bb89ea05f3687d430c, State: Initialized, Role: FOLLOWER
I20260811 18:55:23.227470 11002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } }
I20260811 18:55:23.227550 11002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:23.227592 11002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:23.227648 11002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:23.228164 11002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } }
I20260811 18:55:23.228286 11002 leader_election.cc:302] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19233bbacc1941bb89ea05f3687d430c; no voters:
I20260811 18:55:23.228490 11002 leader_election.cc:288] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:55:23.228554 11005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:23.228641 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 10904
I20260811 18:55:23.228734 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:55:23.228766 11005 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 1 LEADER]: Becoming Leader. State: Replica: 19233bbacc1941bb89ea05f3687d430c, State: Running, Role: LEADER
I20260811 18:55:23.228778 11002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:23.228871 11005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } }
I20260811 18:55:23.228912 24459 external_mini_cluster.cc:1428] Setting key 99059cbd24ee795c7a39d5ca2a1915cd
I20260811 18:55:23.229310 11006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19233bbacc1941bb89ea05f3687d430c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } } }
I20260811 18:55:23.229393 11006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:23.229593 11007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19233bbacc1941bb89ea05f3687d430c. Latest consensus state: current_term: 1 leader_uuid: "19233bbacc1941bb89ea05f3687d430c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } } }
I20260811 18:55:23.229691 11007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:23.229810 11019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:23.230358 11019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:23.230669 11002 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 18:55:23.236670 11019 catalog_manager.cc:1347] Generated new cluster ID: 9b4f5b422ce84265b0cd61c3c18cd0a8
I20260811 18:55:23.236761 11019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:55:23 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:23.243956 11018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:23.229368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46058 (local address 127.23.226.254:37939)
0811 18:55:23.229531 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:23.229543 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:23.230027 (+ 484us) server_negotiation.cc:407] Connection header received
0811 18:55:23.230266 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:23.230273 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:23.230345 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:23.230506 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:23.232703 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.234132 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.235286 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:23.236031 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:23.236148 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:23.239375 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:23.239379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:23.239380 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:23.239394 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:23.241684 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:23.242128 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:23.242132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:23.242133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:23.242250 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:23.242512 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:23.242513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:23.242513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:23.242863 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:23.243006 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:23.243528 (+ 522us) server_negotiation.cc:299] Negotiation successful
0811 18:55:23.243673 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
I20260811 18:55:23.244629 11019 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:55:23.245319 11019 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:23.247977 11019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Generated new TSK 0
I20260811 18:55:23.248147 11019 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:55:23.942214 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:53495/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37939
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:24.056530 11065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:24.056764 11065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:24.056803 11065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:24.057950 11065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:24.058018 11065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:24.058061 11065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:55:24.059621 11065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.23.226.212:53495/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:24.059900 11065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:24.060153 11065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:24.066313 11077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:24.067273 11073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:24.067859 11074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:24.068262 11065 server_base.cc:1034] running on GCE node
I20260811 18:55:24.068468 11065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:24.068742 11065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:24.069919 11065 hybrid_clock.cc:648] HybridClock initialized: now 1786474524069896 us; error 39 us; skew 500 ppm
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:24.073765 11065 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:55:24.074314 11065 webserver.cc:460] Webserver started at http://127.23.226.193:45101/ using document root <none> and password file <none>
I20260811 18:55:24.074661 11065 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:24.074733 11065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:24.074918 11065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:24.089779 11065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "a3ebd27a281d481a829eb125a14dc386"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "1180dc9929948e50507e489c5aa10d30"
server_key_iv: "dc40e88c2dc1c0065b971064115e96ab"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.090297 11065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "a3ebd27a281d481a829eb125a14dc386"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "1180dc9929948e50507e489c5aa10d30"
server_key_iv: "dc40e88c2dc1c0065b971064115e96ab"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.093849 11065 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:55:24.114590 11091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.114886 11065 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.000s sys 0.001s
I20260811 18:55:24.115000 11065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "a3ebd27a281d481a829eb125a14dc386"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "1180dc9929948e50507e489c5aa10d30"
server_key_iv: "dc40e88c2dc1c0065b971064115e96ab"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.115093 11065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:24.131224 11065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:24.133677 11065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:24.133876 11065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:24.134130 11065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:24.134601 11065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:24.134709 11065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.134819 11065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:24.134899 11065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.141389 11065 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:39201
I20260811 18:55:24.141892 11065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:55:24.145092 11248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:39201 every 8 connection(s)
I20260811 18:55:24.149108 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 11065
I20260811 18:55:24.149219 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:55:24.149411 24459 external_mini_cluster.cc:1428] Setting key 3baaf6b303bea47a7a5462b6708b271a
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:24.171310 11252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:24.145797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37939 (local address 127.23.226.193:58717)
0811 18:55:24.158543 (+ 12746us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:24.158612 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:24.159282 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:24.161153 (+ 1871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:24.161158 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:24.161454 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:24.161754 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:24.161761 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.162832 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.162833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:24.164138 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:24.164141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.164933 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.164935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:24.165099 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:24.165746 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:24.165757 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:24.167524 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:24.169632 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:24.169639 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:24.169642 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:24.169926 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:24.170149 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:24.170150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:24.170150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:24.170296 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:24.170624 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:24.170630 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:24.170790 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 18:55:24.170901 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 18:55:24.171055 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12677,"thread_start_us":101,"threads_started":1}
I20260811 18:55:24.171865 11253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:24.145829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:58717 (local address 127.23.226.254:37939)
0811 18:55:24.160872 (+ 15043us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:24.160874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:24.160885 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:55:24.160913 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:24.160914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:24.160928 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:24.161005 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:24.161879 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.162718 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.164446 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.164768 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.164846 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:24.167637 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:24.167639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:24.167639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:24.167648 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:24.169536 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:24.170013 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:24.170014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:24.170014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:24.170078 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:24.170371 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:24.170372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:24.170373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:24.170532 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:24.170595 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:24.171681 (+ 1086us) server_negotiation.cc:299] Negotiation successful
0811 18:55:24.171769 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15007,"thread_start_us":89,"threads_started":1}
I20260811 18:55:24.172720 11249 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37939
I20260811 18:55:24.172821 11249 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:24.173007 11249 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:24.173663 10951 ts_manager.cc:194] Registered new tserver with Master: a3ebd27a281d481a829eb125a14dc386 (127.23.226.193:39201)
I20260811 18:55:24.174634 10951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:58717
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:55:24.209650 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:53495/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37939
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 18:55:24.374822 11258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:24.375058 11258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:24.375097 11258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:24.376614 11258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:24.376693 11258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:24.376739 11258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:55:24.378317 11258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.23.226.212:53495/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:24.378614 11258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:24.378878 11258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:24.384569 11267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:24.384863 11270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:24.384862 11258 server_base.cc:1034] running on GCE node
W20260811 18:55:24.385082 11268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:24.385308 11258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:24.385617 11258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:24.386783 11258 hybrid_clock.cc:648] HybridClock initialized: now 1786474524386756 us; error 43 us; skew 500 ppm
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:24.390020 11258 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:55:24.390628 11258 webserver.cc:460] Webserver started at http://127.23.226.194:45401/ using document root <none> and password file <none>
I20260811 18:55:24.390887 11258 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:24.390955 11258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:24.391101 11258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:24.405509 11258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "66f9a9f748b144679cf053ba2db93098"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "70679311f29edd0ecb8f59c93d287bec"
server_key_iv: "32b18eca4dd1d61a06d8f528fc1064ea"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.405975 11258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "66f9a9f748b144679cf053ba2db93098"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "70679311f29edd0ecb8f59c93d287bec"
server_key_iv: "32b18eca4dd1d61a06d8f528fc1064ea"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.408406 11258 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 18:55:24.423321 11283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.423579 11258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260811 18:55:24.423683 11258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "66f9a9f748b144679cf053ba2db93098"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "70679311f29edd0ecb8f59c93d287bec"
server_key_iv: "32b18eca4dd1d61a06d8f528fc1064ea"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.423803 11258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:24.444685 11258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:24.447575 11258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:24.447829 11258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:24.448200 11258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:24.448652 11258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:24.448746 11258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.448822 11258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:24.448880 11258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.455411 11258 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:39619
I20260811 18:55:24.455938 11258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:24.459201 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 11258
I20260811 18:55:24.459302 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:55:24.459493 24459 external_mini_cluster.cc:1428] Setting key 5a4db93bd8b4f724e1a573e3170251c6
I20260811 18:55:24.466367 11460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:39619 every 8 connection(s)
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:24.481155 11253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:24.467444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:53387 (local address 127.23.226.254:37939)
0811 18:55:24.467499 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:24.467502 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:24.467867 (+ 365us) server_negotiation.cc:407] Connection header received
0811 18:55:24.468712 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:24.468714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:24.468734 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:24.468768 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:24.469703 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.470536 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.472126 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.472455 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.472504 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:24.477768 (+ 5264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:24.477770 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:24.477771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:24.477779 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:24.479431 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:24.479864 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:24.479865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:24.479866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:24.479928 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:24.480243 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:24.480244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:24.480244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:24.480394 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:24.480457 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:24.480885 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 18:55:24.480986 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:55:24.482262 11468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:24.467140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37939 (local address 127.23.226.194:53387)
0811 18:55:24.467591 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:24.467779 (+ 188us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:24.468561 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:24.468979 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:24.468984 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:24.469265 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:24.469584 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:24.469592 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.470675 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.470675 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:24.472024 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:24.472027 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.472630 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.472631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:24.472778 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:24.473390 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:24.473402 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:24.477642 (+ 4240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:24.479519 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:24.479526 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:24.479529 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:24.479766 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:24.480004 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:24.480005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:24.480005 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:24.480159 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:24.480516 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:24.480533 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:24.480719 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 18:55:24.481785 (+ 1066us) client_negotiation.cc:240] Negotiation successful
0811 18:55:24.481970 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":92,"threads_started":1}
I20260811 18:55:24.483024 11464 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37939
I20260811 18:55:24.483158 11464 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:24.483373 11464 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:24.483868 10951 ts_manager.cc:194] Registered new tserver with Master: 66f9a9f748b144679cf053ba2db93098 (127.23.226.194:39619)
I20260811 18:55:24.484387 10951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:53387
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:55:24.497576 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:53495/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37939
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:24.616147 11471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:24.616398 11471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:24.616441 11471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:24.617707 11471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:24.617781 11471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:24.617825 11471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:55:24.619371 11471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.23.226.212:53495/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:24.619639 11471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:24.619916 11471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:24.625245 11487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:24.625511 11482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:24.625720 11483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:24.625841 11471 server_base.cc:1034] running on GCE node
I20260811 18:55:24.626118 11471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:24.626400 11471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:24.627609 11471 hybrid_clock.cc:648] HybridClock initialized: now 1786474524627583 us; error 39 us; skew 500 ppm
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:24.631281 11471 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:55:24.631873 11471 webserver.cc:460] Webserver started at http://127.23.226.195:36269/ using document root <none> and password file <none>
I20260811 18:55:24.632256 11471 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:24.632349 11471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:24.632505 11471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:24.669063 11471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "433e1f437fbe488096412ceaf46f275b"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "922f195fdabc8485076b92caa17dfa56"
server_key_iv: "b204d9ca1a7c25036d008328b1b82696"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.669708 11471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "433e1f437fbe488096412ceaf46f275b"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "922f195fdabc8485076b92caa17dfa56"
server_key_iv: "b204d9ca1a7c25036d008328b1b82696"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.682963 11471 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.000s sys 0.002s
I20260811 18:55:24.706718 11498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.706943 11471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 18:55:24.707083 11471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "433e1f437fbe488096412ceaf46f275b"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "922f195fdabc8485076b92caa17dfa56"
server_key_iv: "b204d9ca1a7c25036d008328b1b82696"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:24.707196 11471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:24.727864 11471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:24.730827 11471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:24.730997 11471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:24.731287 11471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:24.731729 11471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:24.731853 11471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.731940 11471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:24.731971 11471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:24.738790 11471 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:39321
I20260811 18:55:24.739285 11471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:24.742049 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 11471
I20260811 18:55:24.742178 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:55:24.742390 24459 external_mini_cluster.cc:1428] Setting key b8053375f096aeaf2d41b8e08b57d07c
I20260811 18:55:24.747651 11673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:39321 every 8 connection(s)
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:24.758208 11253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:24.748417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:38051 (local address 127.23.226.254:37939)
0811 18:55:24.748481 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:24.748484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:24.748790 (+ 306us) server_negotiation.cc:407] Connection header received
0811 18:55:24.749505 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:24.749507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:24.749520 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:24.749571 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:24.750509 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.751064 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.752131 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.752418 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.752489 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:24.754957 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:24.754960 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:24.754961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:24.754973 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:24.756483 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:24.756990 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:24.756992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:24.756992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:24.757061 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:24.757425 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:24.757426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:24.757426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:24.757562 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:24.757607 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:24.757979 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 18:55:24.758100 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:55:24.758734 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:24.748118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37939 (local address 127.23.226.195:38051)
0811 18:55:24.748637 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:24.748686 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:24.749375 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:24.749786 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:24.749791 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:24.750050 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:24.750352 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:24.750360 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.751171 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.751173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:24.752037 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:24.752039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:24.752515 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:24.752516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:24.752639 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:24.753216 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:24.753225 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:24.754847 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:24.756578 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:24.756585 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:24.756587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:24.756880 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:24.757176 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:24.757176 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:24.757177 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:24.757334 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:24.757659 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:24.757665 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:24.757820 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 18:55:24.758364 (+ 544us) client_negotiation.cc:240] Negotiation successful
0811 18:55:24.758566 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":103,"threads_started":1}
I20260811 18:55:24.759305 11674 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37939
I20260811 18:55:24.759421 11674 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:24.759608 11674 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:24.760010 10951 ts_manager.cc:194] Registered new tserver with Master: 433e1f437fbe488096412ceaf46f275b (127.23.226.195:39321)
I20260811 18:55:24.760385 10951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:38051
I20260811 18:55:24.764777 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:55:24.765384 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 11065
I20260811 18:55:24.813122 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 11258
I20260811 18:55:24.819905 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 11471
I20260811 18:55:24.831775 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 10904
I20260811 18:55:24.847422 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37939
--webserver_interface=127.23.226.254
--webserver_port=35331
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:37939
--ranger_config_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:53495/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.226.212:53495/kms with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:24.931157 11681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:24.931370 11681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:24.931392 11681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:24.932542 11681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:24.932586 11681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:24.932600 11681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:24.932613 11681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:24.932626 11681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:24.934226 11681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.226.212:53495/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:37939
--ranger_config_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=35331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:24.934492 11681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:24.934733 11681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:24.940169 11693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:24.940223 11689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:24.940258 11687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:24.940289 11681 server_base.cc:1034] running on GCE node
I20260811 18:55:24.940639 11681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:24.940966 11681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:24.942169 11681 hybrid_clock.cc:648] HybridClock initialized: now 1786474524942149 us; error 46 us; skew 500 ppm
Aug 11 18:55:24 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:24.944839 11681 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:55:24.945348 11681 webserver.cc:460] Webserver started at http://127.23.226.254:35331/ using document root <none> and password file <none>
I20260811 18:55:24.945580 11681 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:24.945655 11681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:55:25 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474524, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:25.726854 11681 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 18:55:25.727676 11703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:25.727885 11681 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:25.727993 11681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "19233bbacc1941bb89ea05f3687d430c"
format_stamp: "Formatted at 2026-08-11 18:55:23 on dist-test-slave-68xk"
server_key: "b32fb6970ec453765013ffe000333fe7"
server_key_iv: "8f8a552d2e6d288e31b45a166f70cdfa"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:25.728413 11681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:25.737167 11681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:25.739305 11681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:25.739465 11681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:25.743917 11681 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:37939
I20260811 18:55:25.743964 11780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:37939 every 8 connection(s)
I20260811 18:55:25.744334 11681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:25.745558 11781 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:55:25.745821 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 11681
I20260811 18:55:25.746119 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:53495/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:39201
--local_ip_for_outbound_sockets=127.23.226.193
--tserver_master_addrs=127.23.226.254:37939
--webserver_port=45101
--webserver_interface=127.23.226.193
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.226.212:53495/kms with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:25.746395 11781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Bootstrap starting.
I20260811 18:55:25.754678 11781 log.cc:824] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:25.756367 11781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:55:25.756669 11781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Bootstrap complete.
I20260811 18:55:25.759083 11781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } }
I20260811 18:55:25.759334 11781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19233bbacc1941bb89ea05f3687d430c, State: Initialized, Role: FOLLOWER
I20260811 18:55:25.759517 11781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } }
I20260811 18:55:25.759598 11781 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:25.759671 11781 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:25.759724 11781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:55:25.760680 11781 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } }
I20260811 18:55:25.760802 11781 leader_election.cc:302] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19233bbacc1941bb89ea05f3687d430c; no voters:
I20260811 18:55:25.761008 11781 leader_election.cc:288] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:55:25.761040 11789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:55:25.761165 11789 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [term 2 LEADER]: Becoming Leader. State: Replica: 19233bbacc1941bb89ea05f3687d430c, State: Running, Role: LEADER
I20260811 18:55:25.761287 11781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:25.761353 11789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } }
I20260811 18:55:25.761628 11789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19233bbacc1941bb89ea05f3687d430c. Latest consensus state: current_term: 2 leader_uuid: "19233bbacc1941bb89ea05f3687d430c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } } }
I20260811 18:55:25.761718 11789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:25.761641 11791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "19233bbacc1941bb89ea05f3687d430c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19233bbacc1941bb89ea05f3687d430c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37939 } } }
I20260811 18:55:25.761925 11791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:25.762303 11805 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:25.762854 11805 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:25.763041 11805 catalog_manager.cc:1259] Loaded cluster ID: 9b4f5b422ce84265b0cd61c3c18cd0a8
I20260811 18:55:25.763123 11805 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:55:25.763250 11781 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 18:55:25.764379 11805 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:25.764546 11805 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Loaded TSK: 0
I20260811 18:55:25.764768 11805 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:55:25.854030 11786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:25.854341 11786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:25.854378 11786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:25.856137 11786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:25.856201 11786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:25.856242 11786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:55:25.858356 11786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.226.212:53495/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:39201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=45101
--tserver_master_addrs=127.23.226.254:37939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:25.858762 11786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:25.859048 11786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:25.865387 11853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:25.865649 11786 server_base.cc:1034] running on GCE node
W20260811 18:55:25.865694 11849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:25.865869 11850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:25.866112 11786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:25.866396 11786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:25.867604 11786 hybrid_clock.cc:648] HybridClock initialized: now 1786474525867582 us; error 36 us; skew 500 ppm
Aug 11 18:55:25 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474525, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:25.871068 11786 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:55:25.871806 11786 webserver.cc:460] Webserver started at http://127.23.226.193:45101/ using document root <none> and password file <none>
I20260811 18:55:25.872098 11786 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:25.872197 11786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:55:25 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474525, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:25.889233 11786 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 18:55:25.890674 11863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:25.891098 11786 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:55:25.891222 11786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "a3ebd27a281d481a829eb125a14dc386"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "1180dc9929948e50507e489c5aa10d30"
server_key_iv: "dc40e88c2dc1c0065b971064115e96ab"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:25.891605 11786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:25.913672 11786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:25.919365 11786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:25.919551 11786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:25.919860 11786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:25.920310 11786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:25.920373 11786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:25.920430 11786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:25.920462 11786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:25.927569 11786 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:39201
I20260811 18:55:25.928126 11786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:55:25.929379 12036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:39201 every 8 connection(s)
I20260811 18:55:25.934623 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 11786
I20260811 18:55:25.934939 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:53495/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:39619
--local_ip_for_outbound_sockets=127.23.226.194
--tserver_master_addrs=127.23.226.254:37939
--webserver_port=45401
--webserver_interface=127.23.226.194
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.226.212:53495/kms with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:55:25 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474525, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:25.950235 12042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:25.929085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37939 (local address 127.23.226.193:42111)
0811 18:55:25.929765 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:25.929797 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:25.930253 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:25.937670 (+ 7417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:25.937675 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:25.937932 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:25.938222 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:25.938229 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:25.940141 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:25.940143 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:25.941592 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:25.941595 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:25.942516 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:25.942518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:25.942682 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:25.943376 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:25.943389 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:25.945270 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:25.948117 (+ 2847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:25.948125 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:25.948127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:25.948445 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:25.948806 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:25.948807 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:25.948807 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:25.948969 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:25.949516 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:25.949523 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:25.949685 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 18:55:25.949803 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 18:55:25.949970 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":87,"threads_started":1}
I20260811 18:55:25.951368 12043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:25.929156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:42111 (local address 127.23.226.254:37939)
0811 18:55:25.937141 (+ 7985us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:25.937154 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:25.937203 (+ 49us) server_negotiation.cc:407] Connection header received
0811 18:55:25.937361 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:25.937369 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:25.937430 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:25.938360 (+ 930us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:25.938500 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:25.940009 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:25.941723 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:25.942355 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:25.945439 (+ 3084us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:25.945559 (+ 120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:25.945564 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:25.945564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:25.945576 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:25.947997 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:25.948553 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:25.948556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:25.948557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:25.948687 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:25.949059 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:25.949060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:25.949060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:25.949411 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:25.950912 (+ 1501us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:25.950997 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 18:55:25.951140 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7900,"thread_start_us":91,"threads_started":1}
I20260811 18:55:25.952399 12037 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37939
I20260811 18:55:25.952502 12037 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:25.952728 12037 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
W20260811 18:55:25.953763 12037 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:37939 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:55:25.953923 12037 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:25.954061 12037 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:25.954476 12037 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:25.954619 12037 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
W20260811 18:55:25.954993 12037 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:55:26.055287 12044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:26.055510 12044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:26.055536 12044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:26.057366 12044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:26.057507 12044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:26.057622 12044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:55:26.060020 12044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.226.212:53495/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:39619
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=45401
--tserver_master_addrs=127.23.226.254:37939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:26.060539 12044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:26.060925 12044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:26.067806 12049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:26.068097 12044 server_base.cc:1034] running on GCE node
W20260811 18:55:26.067822 12050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:26.070602 12052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:26.070900 12044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:26.071244 12044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:26.072504 12044 hybrid_clock.cc:648] HybridClock initialized: now 1786474526072468 us; error 54 us; skew 500 ppm
Aug 11 18:55:26 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:26.076076 12044 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:55:26.076880 12044 webserver.cc:460] Webserver started at http://127.23.226.194:45401/ using document root <none> and password file <none>
I20260811 18:55:26.077232 12044 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:26.077385 12044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:55:26 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:26.096493 12044 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260811 18:55:26.097620 12065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:26.097859 12044 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:26.097965 12044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "66f9a9f748b144679cf053ba2db93098"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "70679311f29edd0ecb8f59c93d287bec"
server_key_iv: "32b18eca4dd1d61a06d8f528fc1064ea"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:26.098389 12044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:26.122634 12044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:26.125249 12044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:26.125478 12044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:26.125804 12044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:26.126233 12044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:26.126295 12044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:26.126333 12044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:26.126436 12044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:26.133651 12044 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:39619
I20260811 18:55:26.134204 12044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:26.134960 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 12044
I20260811 18:55:26.135309 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.23.226.212:53495/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:39321
--local_ip_for_outbound_sockets=127.23.226.195
--tserver_master_addrs=127.23.226.254:37939
--webserver_port=36269
--webserver_interface=127.23.226.195
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.23.226.212:53495/kms with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:26.136377 12247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:39619 every 8 connection(s)
Aug 11 18:55:26 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:26.149355 12043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:26.137128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:36245 (local address 127.23.226.254:37939)
0811 18:55:26.137186 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:26.137188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:26.137444 (+ 256us) server_negotiation.cc:407] Connection header received
0811 18:55:26.138200 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:26.138202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:26.138222 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:26.138301 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:26.139108 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.139884 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.141726 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.142083 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.142141 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:26.145283 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:26.145284 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:26.145285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:26.145295 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:26.147417 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:26.147995 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:26.147997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:26.147997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:26.148070 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:26.148422 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:26.148424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:26.148424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:26.148587 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:26.148639 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:26.149075 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 18:55:26.149195 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 18:55:26.149997 12254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:26.137066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37939 (local address 127.23.226.194:36245)
0811 18:55:26.137259 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:26.137323 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:26.138056 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:26.138378 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:26.138383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:26.138660 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:26.138972 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:26.138978 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.140004 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.140005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:26.141449 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:26.141454 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.142279 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.142280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:26.142478 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:26.143123 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:26.143135 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:26.145161 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:26.147529 (+ 2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:26.147536 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:26.147539 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:26.147887 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:26.148155 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:26.148156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:26.148156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:26.148329 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:26.148696 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:26.148704 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:26.148894 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 18:55:26.149512 (+ 618us) client_negotiation.cc:240] Negotiation successful
0811 18:55:26.149713 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
I20260811 18:55:26.150547 12250 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37939
I20260811 18:55:26.150655 12250 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:26.150863 12250 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
W20260811 18:55:26.151600 12250 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:37939 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:55:26.151667 12250 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:26.151728 12250 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:26.152112 12250 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:26.152179 12250 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
W20260811 18:55:26.152522 12250 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:55:26.242053 12252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:26.242443 12252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:26.242532 12252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:26.244405 12252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:26.244508 12252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:26.244596 12252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:55:26.246788 12252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.23.226.212:53495/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:39321
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=36269
--tserver_master_addrs=127.23.226.254:37939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:26.247018 12252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:26.247303 12252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:26.257061 12270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:26.257661 12266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:26.257812 12267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:26.258388 12252 server_base.cc:1034] running on GCE node
I20260811 18:55:26.258682 12252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:26.258965 12252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:26.260123 12252 hybrid_clock.cc:648] HybridClock initialized: now 1786474526260114 us; error 27 us; skew 500 ppm
Aug 11 18:55:26 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:26.263293 12252 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:55:26.263814 12252 webserver.cc:460] Webserver started at http://127.23.226.195:36269/ using document root <none> and password file <none>
I20260811 18:55:26.264074 12252 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:26.264163 12252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 18:55:26 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:26.290061 12252 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.001s sys 0.000s
I20260811 18:55:26.293228 12281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:26.293494 12252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260811 18:55:26.293604 12252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "433e1f437fbe488096412ceaf46f275b"
format_stamp: "Formatted at 2026-08-11 18:55:24 on dist-test-slave-68xk"
server_key: "922f195fdabc8485076b92caa17dfa56"
server_key_iv: "b204d9ca1a7c25036d008328b1b82696"
server_key_version: "kuduclusterkey@0"
I20260811 18:55:26.295192 12252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:26.322208 12252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:26.325345 12252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:26.325548 12252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:26.325883 12252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:26.326306 12252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:26.326359 12252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:26.326393 12252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:26.326501 12252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:26.337563 12252 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:39321
I20260811 18:55:26.338184 12252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:26.338315 12454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:39321 every 8 connection(s)
I20260811 18:55:26.344024 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 12252
Aug 11 18:55:26 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:26.350317 12043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:26.339096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:50075 (local address 127.23.226.254:37939)
0811 18:55:26.339162 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:26.339164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:26.339456 (+ 292us) server_negotiation.cc:407] Connection header received
0811 18:55:26.340080 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:26.340081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:26.340098 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:26.340178 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:26.340730 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.341593 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.342843 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.343179 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.343266 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:26.346693 (+ 3427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:26.346694 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:26.346694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:26.346702 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:26.348526 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:26.349229 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:26.349230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:26.349230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:26.349284 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:26.349565 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:26.349566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:26.349566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:26.349681 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:26.349755 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:26.350103 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 18:55:26.350205 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:55:26.350461 12457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:26.339105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37939 (local address 127.23.226.195:50075)
0811 18:55:26.339315 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:26.339363 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:26.339961 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:26.340241 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:26.340245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:26.340426 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:26.340624 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:26.340629 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.341711 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.341712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:26.342748 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:26.342751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.343368 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.343370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:26.343526 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:26.344695 (+ 1169us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:26.344707 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:26.346568 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:26.348750 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:26.348756 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:26.348758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:26.349081 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:26.349356 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:26.349357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:26.349357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:26.349485 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:26.349759 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:26.349766 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:26.349929 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 18:55:26.350040 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 18:55:26.350213 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":104,"threads_started":1}
I20260811 18:55:26.350966 12455 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37939
I20260811 18:55:26.351104 12455 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:26.351307 12455 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
W20260811 18:55:26.352108 12455 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:37939 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 18:55:26.352186 12455 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:26.352254 12455 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:26.352871 12455 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:26.352983 12455 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
W20260811 18:55:26.353545 12455 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:55:26.355145 12458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:26.344540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46068 (local address 127.23.226.254:37939)
0811 18:55:26.344687 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:26.344688 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:26.345692 (+ 1004us) server_negotiation.cc:407] Connection header received
0811 18:55:26.345722 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:26.345723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:26.345738 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:26.345815 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:26.347161 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.347754 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.349784 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:26.350097 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:26.350167 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:26.352360 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:26.352361 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:26.352361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:26.352369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:26.353966 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:26.354310 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:26.354311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:26.354312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:26.354371 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:26.354629 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:26.354630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:26.354630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:26.354748 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:26.354904 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:26.354944 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 18:55:26.355031 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":90,"threads_started":1}
Aug 11 18:55:26 dist-test-slave-68xk krb5kdc[10247](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:26.955224 12037 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:26.955386 12037 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:26.955799 11728 ts_manager.cc:194] Registered new tserver with Master: a3ebd27a281d481a829eb125a14dc386 (127.23.226.193:39201)
I20260811 18:55:26.956854 11728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:42111
I20260811 18:55:27.152709 12250 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:27.152874 12250 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:27.153182 11728 ts_manager.cc:194] Registered new tserver with Master: 66f9a9f748b144679cf053ba2db93098 (127.23.226.194:39619)
I20260811 18:55:27.153744 11728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:36245
Aug 11 18:55:27 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:27.353775 12455 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:27.353947 12455 heartbeater.cc:511] Master 127.23.226.254:37939 requested a full tablet report, sending...
I20260811 18:55:27.354305 11728 ts_manager.cc:194] Registered new tserver with Master: 433e1f437fbe488096412ceaf46f275b (127.23.226.195:39321)
I20260811 18:55:27.354851 11728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:50075
I20260811 18:55:27.358598 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:55:27.373023 12487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.359637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46074 (local address 127.23.226.254:37939)
0811 18:55:27.364824 (+ 5187us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:27.364827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:27.364838 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:55:27.364864 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:27.364865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:27.364878 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:27.364956 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:27.365798 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.366633 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.367682 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.367990 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.368046 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.369711 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:27.369712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:27.369712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:27.369721 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:27.371593 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:27.371991 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:27.371993 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:27.371993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:27.372049 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:27.372246 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:27.372247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:27.372248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:27.372371 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:27.372452 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:27.372832 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 18:55:27.372910 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5163,"thread_start_us":71,"threads_started":1}
I20260811 18:55:27.380113 11728 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:55:27.383205 11728 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:55:27.393882 12496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.386732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39619 (local address 127.0.0.1:53434)
0811 18:55:27.386967 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.387009 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:27.387079 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:27.387722 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:27.387725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:27.387728 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:27.387877 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.387880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.389385 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.389386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.390722 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.390725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.393508 (+ 2783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.393509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.393618 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.393645 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 18:55:27.393736 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:55:27.393797 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":91,"threads_started":1}
I20260811 18:55:27.393934 12503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.387192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53434 (local address 127.23.226.194:39619)
0811 18:55:27.387326 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:27.387332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:27.387344 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:55:27.387555 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:27.387558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:27.387577 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:27.387654 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:27.387946 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.389085 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.392278 (+ 3193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.393353 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.393447 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.393517 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:27.393755 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 18:55:27.393797 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":67,"threads_started":1}
I20260811 18:55:27.395601 12139 tablet_service.cc:1467] Processing CreateTablet for tablet ab91ad76f82c4fa98b9153c74ce07269 (DEFAULT_TABLE table=test-table [id=bdcc8783e6b84deba98963990c11e760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:27.396055 12139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab91ad76f82c4fa98b9153c74ce07269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:27.396679 12499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.386737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:39321 (local address 127.0.0.1:47000)
0811 18:55:27.388030 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.388040 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:27.388124 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:27.388547 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:27.388548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:27.388550 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:27.388588 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.388589 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.391960 (+ 3371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.391961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.393279 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.393282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.396392 (+ 3110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.396393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.396464 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.396468 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:55:27.396521 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:55:27.396569 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1244,"thread_start_us":114,"threads_started":1}
I20260811 18:55:27.397145 12497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.386829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47000 (local address 127.23.226.195:39321)
0811 18:55:27.387662 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:27.387667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:27.388095 (+ 428us) server_negotiation.cc:407] Connection header received
0811 18:55:27.388207 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:27.388210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:27.388227 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:27.388303 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:27.388679 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.391841 (+ 3162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.395139 (+ 3298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.396034 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.396121 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.396305 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:27.396984 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 18:55:27.397048 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":782,"thread_start_us":53,"threads_started":1}
I20260811 18:55:27.398232 12495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.386986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39201 (local address 127.0.0.1:33344)
0811 18:55:27.394103 (+ 7117us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.394189 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:27.394251 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:27.394605 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:27.394606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:27.394608 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:27.394648 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.394649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.395891 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.395892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.397010 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.397013 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.397992 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.397993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.398055 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.398060 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:55:27.398106 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 18:55:27.398157 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7098,"thread_start_us":62,"threads_started":1}
I20260811 18:55:27.398190 12351 tablet_service.cc:1467] Processing CreateTablet for tablet ab91ad76f82c4fa98b9153c74ce07269 (DEFAULT_TABLE table=test-table [id=bdcc8783e6b84deba98963990c11e760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:27.398594 12351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab91ad76f82c4fa98b9153c74ce07269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:27.398707 12502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.387089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33344 (local address 127.23.226.193:39201)
0811 18:55:27.393465 (+ 6376us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:27.393471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:27.394320 (+ 849us) server_negotiation.cc:407] Connection header received
0811 18:55:27.394363 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:27.394365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:27.394381 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:27.394502 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:27.394723 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.395792 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.397107 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.397830 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.397907 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.397956 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:27.398591 (+ 635us) server_negotiation.cc:299] Negotiation successful
0811 18:55:27.398631 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6334,"thread_start_us":97,"threads_started":1}
I20260811 18:55:27.401189 11902 tablet_service.cc:1467] Processing CreateTablet for tablet ab91ad76f82c4fa98b9153c74ce07269 (DEFAULT_TABLE table=test-table [id=bdcc8783e6b84deba98963990c11e760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:27.401515 11902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab91ad76f82c4fa98b9153c74ce07269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:27.406569 12506 tablet_bootstrap.cc:492] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386: Bootstrap starting.
I20260811 18:55:27.407433 12506 tablet_bootstrap.cc:654] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:27.407451 12504 tablet_bootstrap.cc:492] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: Bootstrap starting.
I20260811 18:55:27.407889 12506 log.cc:824] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:27.408171 12504 tablet_bootstrap.cc:654] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:27.408530 12504 log.cc:824] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:27.408879 12506 tablet_bootstrap.cc:492] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386: No bootstrap required, opened a new log
I20260811 18:55:27.408931 12507 tablet_bootstrap.cc:492] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: Bootstrap starting.
I20260811 18:55:27.409039 12506 ts_tablet_manager.cc:1397] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:55:27.409453 12504 tablet_bootstrap.cc:492] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: No bootstrap required, opened a new log
I20260811 18:55:27.409528 12504 ts_tablet_manager.cc:1397] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:55:27.411921 12506 raft_consensus.cc:348] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.412107 12506 raft_consensus.cc:374] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:27.412180 12506 raft_consensus.cc:729] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ebd27a281d481a829eb125a14dc386, State: Initialized, Role: FOLLOWER
I20260811 18:55:27.412335 12504 raft_consensus.cc:348] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.412416 12506 consensus_queue.cc:260] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.412583 12504 raft_consensus.cc:374] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:27.412681 12504 raft_consensus.cc:729] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66f9a9f748b144679cf053ba2db93098, State: Initialized, Role: FOLLOWER
I20260811 18:55:27.412817 12507 tablet_bootstrap.cc:654] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:27.412880 12506 ts_tablet_manager.cc:1428] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 18:55:27.412874 12504 consensus_queue.cc:260] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.413102 12037 heartbeater.cc:503] Master 127.23.226.254:37939 was elected leader, sending a full tablet report...
I20260811 18:55:27.413203 12504 ts_tablet_manager.cc:1428] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 18:55:27.413239 12507 log.cc:824] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:27.413326 12250 heartbeater.cc:503] Master 127.23.226.254:37939 was elected leader, sending a full tablet report...
I20260811 18:55:27.414080 12507 tablet_bootstrap.cc:492] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: No bootstrap required, opened a new log
I20260811 18:55:27.414171 12507 ts_tablet_manager.cc:1397] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 18:55:27.416829 12507 raft_consensus.cc:348] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.416965 12507 raft_consensus.cc:374] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:27.416989 12507 raft_consensus.cc:729] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 433e1f437fbe488096412ceaf46f275b, State: Initialized, Role: FOLLOWER
I20260811 18:55:27.417167 12507 consensus_queue.cc:260] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.417454 12507 ts_tablet_manager.cc:1428] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:27.417508 12455 heartbeater.cc:503] Master 127.23.226.254:37939 was elected leader, sending a full tablet report...
W20260811 18:55:27.430811 12038 tablet.cc:2369] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:55:27.458014 12515 raft_consensus.cc:482] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:27.458338 12515 raft_consensus.cc:504] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.459035 12515 leader_election.cc:288] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 433e1f437fbe488096412ceaf46f275b (127.23.226.195:39321), a3ebd27a281d481a829eb125a14dc386 (127.23.226.193:39201)
I20260811 18:55:27.464560 12502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.459768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:43685 (local address 127.23.226.193:39201)
0811 18:55:27.459851 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:27.459853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:27.460100 (+ 247us) server_negotiation.cc:407] Connection header received
0811 18:55:27.460210 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:27.460211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:27.460222 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:27.460251 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:27.460734 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.461495 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.463355 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.464005 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.464060 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.464070 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:27.464441 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 18:55:27.464485 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:55:27.465193 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.459399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39201 (local address 127.23.226.194:43685)
0811 18:55:27.460023 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.460035 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:27.460132 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:27.460344 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:27.460345 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:27.460347 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:27.460626 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.460629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.461605 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.461606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.463237 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.463241 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.464209 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.464210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.464331 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.464336 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:55:27.464875 (+ 539us) client_negotiation.cc:240] Negotiation successful
0811 18:55:27.464919 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":166,"threads_started":1}
I20260811 18:55:27.465194 12497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.459740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:46971 (local address 127.23.226.195:39321)
0811 18:55:27.459792 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:27.459795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:27.460061 (+ 266us) server_negotiation.cc:407] Connection header received
0811 18:55:27.460256 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:27.460258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:27.460268 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:27.460310 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:27.460830 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.461794 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.463859 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.464486 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.464538 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.464545 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:27.465010 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 18:55:27.465088 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:55:27.465536 12524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.459262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:39321 (local address 127.23.226.194:46971)
0811 18:55:27.459956 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.459977 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:27.460122 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:27.460445 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:27.460446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:27.460449 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:27.460662 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.460665 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.462137 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.462138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.463752 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:27.463755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.464607 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.464608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:27.464830 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.464843 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 18:55:27.465303 (+ 460us) client_negotiation.cc:240] Negotiation successful
0811 18:55:27.465369 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":220,"threads_started":1}
I20260811 18:55:27.466063 11959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab91ad76f82c4fa98b9153c74ce07269" candidate_uuid: "66f9a9f748b144679cf053ba2db93098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ebd27a281d481a829eb125a14dc386" is_pre_election: true
I20260811 18:55:27.466310 11959 raft_consensus.cc:2454] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66f9a9f748b144679cf053ba2db93098 in term 0.
I20260811 18:55:27.466759 12068 leader_election.cc:302] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66f9a9f748b144679cf053ba2db93098, a3ebd27a281d481a829eb125a14dc386; no voters:
I20260811 18:55:27.466863 12384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab91ad76f82c4fa98b9153c74ce07269" candidate_uuid: "66f9a9f748b144679cf053ba2db93098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "433e1f437fbe488096412ceaf46f275b" is_pre_election: true
I20260811 18:55:27.467020 12384 raft_consensus.cc:2454] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66f9a9f748b144679cf053ba2db93098 in term 0.
I20260811 18:55:27.467196 12515 raft_consensus.cc:2781] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:55:27.467289 12515 raft_consensus.cc:482] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:55:27.467332 12515 raft_consensus.cc:3037] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:27.468783 12515 raft_consensus.cc:504] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.468921 12515 leader_election.cc:288] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [CANDIDATE]: Term 1 election: Requested vote from peers 433e1f437fbe488096412ceaf46f275b (127.23.226.195:39321), a3ebd27a281d481a829eb125a14dc386 (127.23.226.193:39201)
I20260811 18:55:27.469139 12384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab91ad76f82c4fa98b9153c74ce07269" candidate_uuid: "66f9a9f748b144679cf053ba2db93098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "433e1f437fbe488096412ceaf46f275b"
I20260811 18:55:27.469211 12384 raft_consensus.cc:3037] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:27.469329 11959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab91ad76f82c4fa98b9153c74ce07269" candidate_uuid: "66f9a9f748b144679cf053ba2db93098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ebd27a281d481a829eb125a14dc386"
I20260811 18:55:27.469424 11959 raft_consensus.cc:3037] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:27.470338 12384 raft_consensus.cc:2454] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66f9a9f748b144679cf053ba2db93098 in term 1.
I20260811 18:55:27.470633 12069 leader_election.cc:302] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 433e1f437fbe488096412ceaf46f275b, 66f9a9f748b144679cf053ba2db93098; no voters:
I20260811 18:55:27.470747 12515 raft_consensus.cc:2781] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:27.470901 12515 raft_consensus.cc:686] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 1 LEADER]: Becoming Leader. State: Replica: 66f9a9f748b144679cf053ba2db93098, State: Running, Role: LEADER
I20260811 18:55:27.470912 11959 raft_consensus.cc:2454] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66f9a9f748b144679cf053ba2db93098 in term 1.
I20260811 18:55:27.470983 12515 consensus_queue.cc:237] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } }
I20260811 18:55:27.471786 11728 catalog_manager.cc:5495] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66f9a9f748b144679cf053ba2db93098 (127.23.226.194). New cstate: current_term: 1 leader_uuid: "66f9a9f748b144679cf053ba2db93098" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66f9a9f748b144679cf053ba2db93098" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 } health_report { overall_health: UNKNOWN } } }
I20260811 18:55:27.492952 12503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.489267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53448 (local address 127.23.226.194:39619)
0811 18:55:27.489324 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:27.489326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:27.489335 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:55:27.489390 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:27.489391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:27.489423 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:27.489521 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:55:27.489679 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.490603 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.491772 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:27.492071 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:27.492151 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:27.492418 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:55:27.492582 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:55:27.492759 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:27.492796 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 18:55:27.492830 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:55:27.496145 11959 raft_consensus.cc:1261] T ab91ad76f82c4fa98b9153c74ce07269 P a3ebd27a281d481a829eb125a14dc386 [term 1 FOLLOWER]: Refusing update from remote peer 66f9a9f748b144679cf053ba2db93098: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:27.496168 12384 raft_consensus.cc:1261] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 1 FOLLOWER]: Refusing update from remote peer 66f9a9f748b144679cf053ba2db93098: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:27.496512 12515 consensus_queue.cc:1035] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "433e1f437fbe488096412ceaf46f275b" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:27.496781 12525 consensus_queue.cc:1035] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ebd27a281d481a829eb125a14dc386" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:27.508667 12529 mvcc.cc:205] Tried to move back new op lower bound from 7317399664621297664 to 7317399664521752576. Current Snapshot: MvccSnapshot[applied={T|T < 7317399664621297664}]
I20260811 18:55:27.509764 12533 mvcc.cc:205] Tried to move back new op lower bound from 7317399664621297664 to 7317399664521752576. Current Snapshot: MvccSnapshot[applied={T|T < 7317399664621297664}]
I20260811 18:55:27.511839 11727 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:27.512017 11727 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:27.512887 11727 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 19233bbacc1941bb89ea05f3687d430c: Sending DeleteTablet for 3 replicas of tablet ab91ad76f82c4fa98b9153c74ce07269
I20260811 18:55:27.513556 12351 tablet_service.cc:1514] Processing DeleteTablet for tablet ab91ad76f82c4fa98b9153c74ce07269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:27 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:47000
I20260811 18:55:27.513983 11902 tablet_service.cc:1514] Processing DeleteTablet for tablet ab91ad76f82c4fa98b9153c74ce07269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:27 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:33344
I20260811 18:55:27.529992 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 11786
I20260811 18:55:27.538610 12139 tablet_service.cc:1514] Processing DeleteTablet for tablet ab91ad76f82c4fa98b9153c74ce07269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:27 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:53434
I20260811 18:55:27.541965 12531 mvcc.cc:205] Tried to move back new op lower bound from 7317399664621297664 to 7317399664521752576. Current Snapshot: MvccSnapshot[applied={T|T < 7317399664621297664 or (T in {7317399664621297664})}]
I20260811 18:55:27.542184 12548 tablet_replica.cc:330] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: stopping tablet replica
I20260811 18:55:27.542320 12548 raft_consensus.cc:2229] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:55:27.542497 12548 raft_consensus.cc:2258] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:27.545182 12545 tablet_replica.cc:330] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: stopping tablet replica
I20260811 18:55:27.545374 12545 raft_consensus.cc:2229] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:27.545504 12545 raft_consensus.cc:2258] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:27.546120 12548 ts_tablet_manager.cc:1905] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 18:55:27.548169 11704 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:39201 (error 108)
I20260811 18:55:27.549187 12499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.549057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39201 (local address 127.0.0.1:33350)
0811 18:55:27.549105 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.549144 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 18:55:27.549198 12548 ts_tablet_manager.cc:1918] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:27.549211 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 12044
I20260811 18:55:27.549304 12548 log.cc:1196] T ab91ad76f82c4fa98b9153c74ce07269 P 66f9a9f748b144679cf053ba2db93098: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/ab91ad76f82c4fa98b9153c74ce07269
W20260811 18:55:27.549322 11704 catalog_manager.cc:4584] TS a3ebd27a281d481a829eb125a14dc386 (127.23.226.193:39201): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ab91ad76f82c4fa98b9153c74ce07269: Network error: Client connection negotiation failed: client connection to 127.23.226.193:39201: connect: Connection refused (error 111)
I20260811 18:55:27.553062 12545 ts_tablet_manager.cc:1905] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:27.555413 12545 ts_tablet_manager.cc:1918] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:27.555527 12545 log.cc:1196] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/ab91ad76f82c4fa98b9153c74ce07269
I20260811 18:55:27.555924 12545 ts_tablet_manager.cc:1939] T ab91ad76f82c4fa98b9153c74ce07269 P 433e1f437fbe488096412ceaf46f275b: Deleting consensus metadata
I20260811 18:55:27.556520 11705 catalog_manager.cc:4841] TS 433e1f437fbe488096412ceaf46f275b (127.23.226.195:39321): tablet ab91ad76f82c4fa98b9153c74ce07269 (table test-table [id=bdcc8783e6b84deba98963990c11e760]) successfully deleted
I20260811 18:55:27.601995 12499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.601804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39201 (local address 127.0.0.1:33356)
0811 18:55:27.601893 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.601944 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 18:55:27.602375 12499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.602289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39201 (local address 127.0.0.1:33364)
0811 18:55:27.602327 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.602349 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:39201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 18:55:27.610829 12499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.610711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39619 (local address 127.0.0.1:53454)
0811 18:55:27.610769 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.610795 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.194:39619: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 18:55:27.611120 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 12252
I20260811 18:55:27.643157 12499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.643009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39619 (local address 127.0.0.1:53466)
0811 18:55:27.643070 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.643105 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.194:39619: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 18:55:27.643983 12499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:27.643878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39619 (local address 127.0.0.1:53482)
0811 18:55:27.643925 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:27.643950 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.194:39619: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 18:55:27.645752 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 11681
Aug 11 18:55:27 dist-test-slave-68xk krb5kdc[10247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474526, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for HTTP/127.23.226.212@KRBTEST.COM
I20260811 18:55:27.667239 24459 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 18:55:28.012036 24459 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 18:55:28.012148 24459 mini_ranger.cc:66] Stopping Ranger...
I20260811 18:55:28.358316 24459 mini_ranger.cc:68] Stopped Ranger
2026-08-11 18:55:28.358 UTC [10284] LOG: received smart shutdown request
2026-08-11 18:55:28.363 UTC [10284] LOG: background worker "logical replication launcher" (PID 10297) exited with exit code 1
2026-08-11 18:55:28.363 UTC [10291] LOG: shutting down
2026-08-11 18:55:28.570 UTC [10284] LOG: database system is shut down
2026-08-11T18:55:28Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51570 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:55:28 dist-test-slave-68xk krb5kdc[12562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:55:28 dist-test-slave-68xk krb5kdc[12562](info): set up 2 sockets
Aug 11 18:55:28 dist-test-slave-68xk krb5kdc[12562](info): commencing operation
krb5kdc: starting...
W20260811 18:55:29.986392 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:55:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:55:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:55:30.114463 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:33291
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:33291,127.23.226.253:36227,127.23.226.252:32891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:30.197858 12585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:30.198137 12585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:30.198181 12585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:30.199424 12585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:30.199502 12585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:30.199527 12585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:30.199546 12585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:30.199565 12585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:30.201159 12585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:33291,127.23.226.253:36227,127.23.226.252:32891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:33291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:30.201478 12585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:30.201733 12585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:30.206980 12599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:30.207098 12585 server_base.cc:1034] running on GCE node
W20260811 18:55:30.206959 12592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:30.207170 12597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:30.207536 12585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:30.207868 12585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:30.209045 12585 hybrid_clock.cc:648] HybridClock initialized: now 1786474530209041 us; error 52 us; skew 500 ppm
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:30.212101 12585 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:55:30.212615 12585 webserver.cc:460] Webserver started at http://127.23.226.254:34831/ using document root <none> and password file <none>
I20260811 18:55:30.212860 12585 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:30.212932 12585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:30.213099 12585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:30.214290 12585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "8715b36f70e643da8126f21bb191b407"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "f6724aa607f83aef45e07104f18d67be"
server_key_iv: "7480a2b7c02b694a9c1fe6cd742a79a1"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.214757 12585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "8715b36f70e643da8126f21bb191b407"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "f6724aa607f83aef45e07104f18d67be"
server_key_iv: "7480a2b7c02b694a9c1fe6cd742a79a1"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.216194 12585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:30.217015 12610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:30.217208 12585 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:55:30.217329 12585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "8715b36f70e643da8126f21bb191b407"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "f6724aa607f83aef45e07104f18d67be"
server_key_iv: "7480a2b7c02b694a9c1fe6cd742a79a1"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.217408 12585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:30.237076 12585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:30.239315 12585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:30.239500 12585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:30.243921 12585 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:33291
I20260811 18:55:30.244010 12682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:33291 every 8 connection(s)
I20260811 18:55:30.244393 12585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:30.245380 12683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:30.247054 12683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:55:30.249990 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 12585
I20260811 18:55:30.250082 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:55:30.250295 24459 external_mini_cluster.cc:1428] Setting key dc58608c2dd210c56fca5b2edba74d94
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:30.258168 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.247808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33291 (local address 127.0.0.1:50990)
0811 18:55:30.247990 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.248034 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.248481 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.248758 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.248761 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.249036 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.249191 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.249195 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.250349 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.250350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.251109 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.251112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.251639 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.251640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.251716 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.252302 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.252311 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.254000 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.256363 (+ 2363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.256370 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.256372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.256595 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.257039 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.257040 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.257041 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.257187 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.257665 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.257671 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.257733 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.257813 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.257951 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
I20260811 18:55:30.258181 12692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.247871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50990 (local address 127.23.226.254:33291)
0811 18:55:30.248075 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.248078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.248112 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:55:30.248612 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.248614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.248631 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.248716 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.249278 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.250252 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.251207 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.251534 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.251666 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.254094 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.254102 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.254103 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.254111 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.256263 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.256688 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.256691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.256692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.256816 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.257276 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.257277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.257278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.257586 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.257681 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.257871 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.258045 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":163,"thread_start_us":105,"threads_started":1}
I20260811 18:55:30.259099 12683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:55:30.259487 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.259366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58548)
0811 18:55:30.259411 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.259453 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 18:55:30.259608 12620 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.23.226.253@KRBTEST.COM; defaulting to no policy
I20260811 18:55:30.260128 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.260004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58554)
0811 18:55:30.260061 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.260095 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 18:55:30.260288 12683 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:36227: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab.
Entry for principal kudu/127.23.226.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab.
I20260811 18:55:30.282049 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.253:36227
--webserver_interface=127.23.226.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab
--principal=kudu/127.23.226.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:33291,127.23.226.253:36227,127.23.226.252:32891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:30.309531 12683 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } attempt: 1
I20260811 18:55:30.310180 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.310000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58564)
0811 18:55:30.310080 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.310137 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 18:55:30.310667 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.310533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58580)
0811 18:55:30.310597 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.310641 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 18:55:30.310820 12683 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:36227: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
W20260811 18:55:30.373267 12698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:30.373504 12698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:30.373529 12698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:30.374835 12698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:30.374892 12698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:30.374907 12698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:30.374920 12698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:30.374933 12698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:30.376580 12698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:33291,127.23.226.253:36227,127.23.226.252:32891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab
--principal=kudu/127.23.226.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.253:36227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.226.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:30.376874 12698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:30.377125 12698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:55:30.379019 12683 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } attempt: 2
I20260811 18:55:30.379492 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.379351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58594)
0811 18:55:30.379421 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.379463 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 18:55:30.379868 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.379763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58610)
0811 18:55:30.379813 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.379847 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 18:55:30.379959 12683 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:36227: Network error: Client connection negotiation failed: client connection to 127.23.226.253:36227: connect: Connection refused (error 111)
W20260811 18:55:30.382537 12710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:30.382555 12708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:30.382833 12698 server_base.cc:1034] running on GCE node
W20260811 18:55:30.382555 12707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:30.383160 12698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:30.383481 12698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:30.384691 12698 hybrid_clock.cc:648] HybridClock initialized: now 1786474530384685 us; error 40 us; skew 500 ppm
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:30.387693 12698 init.cc:377] Logged in from keytab as kudu/127.23.226.253@KRBTEST.COM (short username kudu)
I20260811 18:55:30.388273 12698 webserver.cc:460] Webserver started at http://127.23.226.253:45087/ using document root <none> and password file <none>
I20260811 18:55:30.388548 12698 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:30.388634 12698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:30.388801 12698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:30.390005 12698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/data/instance:
uuid: "6cc2b119a3f64db49b922f18259538bb"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "e9d88155bfdb15cff529a2bed0d26b01"
server_key_iv: "5938a8b5f18ddee64e500d73f7eabc1e"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.390496 12698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/wal/instance:
uuid: "6cc2b119a3f64db49b922f18259538bb"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "e9d88155bfdb15cff529a2bed0d26b01"
server_key_iv: "5938a8b5f18ddee64e500d73f7eabc1e"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.392226 12698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:30.393147 12718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:30.393361 12698 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:30.393481 12698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/wal
uuid: "6cc2b119a3f64db49b922f18259538bb"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "e9d88155bfdb15cff529a2bed0d26b01"
server_key_iv: "5938a8b5f18ddee64e500d73f7eabc1e"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.393574 12698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:30.410019 12698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:30.412670 12698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:30.412899 12698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:30.417773 12698 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.253:36227
I20260811 18:55:30.417814 12819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.253:36227 every 8 connection(s)
I20260811 18:55:30.418234 12698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
I20260811 18:55:30.418503 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 12698
I20260811 18:55:30.418619 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-1/wal/instance
I20260811 18:55:30.418854 24459 external_mini_cluster.cc:1428] Setting key c3f2ab7f95f13fe5df038894faf8412b
I20260811 18:55:30.419456 12820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:30.421667 12820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.23.226.252@KRBTEST.COM; defaulting to no policy
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.252@KRBTEST.COM" created.
I20260811 18:55:30.432646 12692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.422509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51004 (local address 127.23.226.254:33291)
0811 18:55:30.422572 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.422575 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.422904 (+ 329us) server_negotiation.cc:407] Connection header received
0811 18:55:30.423689 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.423691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.423704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.423773 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.424659 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.425181 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.426752 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.426957 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.427016 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.429570 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.429572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.429572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.429579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.431099 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.431560 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.431562 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.431562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.431631 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.431959 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.431960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.431960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.432076 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.432163 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.432460 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.432548 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:55:30.432878 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.422531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33291 (local address 127.0.0.1:51004)
0811 18:55:30.422728 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.422783 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.423526 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.423856 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.423860 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.424253 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.424558 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.424564 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.425290 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.425291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.426665 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.426669 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.427055 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.427056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.427206 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.427761 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.427773 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.429475 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.431177 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.431185 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.431187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.431454 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.431704 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.431705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.431705 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.431884 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.432159 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.432168 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.432320 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.432438 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.432609 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
I20260811 18:55:30.433547 12820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:55:30.442480 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.433855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58620)
0811 18:55:30.434094 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.434107 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.434165 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.434321 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.434322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.434576 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.434653 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.434656 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.435905 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.435906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.436396 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.436398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.437099 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.437100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.437160 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.437636 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.437641 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.438954 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.441097 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.441098 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.441099 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.441302 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.441534 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.441535 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.441535 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.441590 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.442140 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.442141 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.442179 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.442258 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.442345 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221}
I20260811 18:55:30.442675 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.433928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58620 (local address 127.23.226.253:36227)
0811 18:55:30.434113 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.434117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.434158 (+ 41us) server_negotiation.cc:407] Connection header received
0811 18:55:30.434222 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.434224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.434235 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.434298 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.434740 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.435804 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.436487 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.437014 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.437095 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.439047 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.439057 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.439057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.439065 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.440983 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.441398 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.441402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.441402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.441467 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.441804 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.441805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.441805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.442061 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.442151 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.442305 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.442483 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":155,"thread_start_us":108,"threads_started":1}
I20260811 18:55:30.443375 12820 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:55:30.443797 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.443645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32814)
0811 18:55:30.443709 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.443768 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 18:55:30.443970 12723 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
I20260811 18:55:30.444526 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.444432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32828)
0811 18:55:30.444483 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.444509 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 18:55:30.444656 12820 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:32891: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab.
Entry for principal kudu/127.23.226.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab.
I20260811 18:55:30.450779 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.252:32891
--webserver_interface=127.23.226.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab
--principal=kudu/127.23.226.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:33291,127.23.226.253:36227,127.23.226.252:32891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:30.471103 12683 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } attempt: 3
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:55:30.478705 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.471501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58624)
0811 18:55:30.471569 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.471583 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.471659 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.471842 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.471843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.472017 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.472086 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.472088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.472809 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.472811 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.473343 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.473344 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.473780 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.473782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.473872 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.474372 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.474378 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.475867 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.477568 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.477569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.477570 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.477752 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.477972 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.477973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.477974 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.478039 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.478316 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.478317 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.478369 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.478485 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.478598 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 18:55:30.478700 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.471576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58624 (local address 127.23.226.253:36227)
0811 18:55:30.471650 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.471653 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.471665 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:55:30.471742 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.471743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.471763 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.471823 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.472179 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.472689 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.473436 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.473664 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.473768 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.475964 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.475966 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.475966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.475974 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.477457 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.477829 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.477830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.477831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.477895 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.478106 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.478107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.478108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.478239 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.478324 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.478513 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.478598 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 18:55:30.479162 12683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:55:30.479542 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.479434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32832)
0811 18:55:30.479487 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.479516 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 18:55:30.479866 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.479775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32834)
0811 18:55:30.479821 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.479845 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 18:55:30.479961 12683 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:32891: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
I20260811 18:55:30.493927 12820 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } attempt: 1
I20260811 18:55:30.494500 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.494304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32846)
0811 18:55:30.494378 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.494459 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 18:55:30.494918 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.494817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32860)
0811 18:55:30.494868 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.494897 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 18:55:30.495028 12820 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:32891: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
I20260811 18:55:30.511139 12683 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } attempt: 1
I20260811 18:55:30.511724 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.511576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32870)
0811 18:55:30.511646 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.511691 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 18:55:30.512149 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.512038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32886)
0811 18:55:30.512098 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.512126 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 18:55:30.512373 12683 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:32891: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
W20260811 18:55:30.537927 12829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:30.538133 12829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:30.538156 12829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:30.539356 12829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:30.539399 12829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:30.539414 12829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:30.539427 12829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:30.539439 12829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:30.540927 12829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:33291,127.23.226.253:36227,127.23.226.252:32891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab
--principal=kudu/127.23.226.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.252:32891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.226.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:30.541182 12829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:30.541420 12829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:30.546326 12839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:30.546502 12838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:30.546334 12841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:30.546561 12829 server_base.cc:1034] running on GCE node
I20260811 18:55:30.546833 12829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:30.547068 12829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:30.548202 12829 hybrid_clock.cc:648] HybridClock initialized: now 1786474530548191 us; error 29 us; skew 500 ppm
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:30.551014 12829 init.cc:377] Logged in from keytab as kudu/127.23.226.252@KRBTEST.COM (short username kudu)
I20260811 18:55:30.551529 12829 webserver.cc:460] Webserver started at http://127.23.226.252:39547/ using document root <none> and password file <none>
I20260811 18:55:30.551774 12829 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:30.551844 12829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:30.551982 12829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:30.553155 12829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/data/instance:
uuid: "2f9cbc57dc23487db2c131af60728376"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "370a21022208f7f7093fb75787e36928"
server_key_iv: "5722743dabcd985e3b515c8639da0a33"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.553582 12829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/wal/instance:
uuid: "2f9cbc57dc23487db2c131af60728376"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "370a21022208f7f7093fb75787e36928"
server_key_iv: "5722743dabcd985e3b515c8639da0a33"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.555128 12829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:55:30.556010 12851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:30.556381 12829 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:30.556478 12829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/wal
uuid: "2f9cbc57dc23487db2c131af60728376"
format_stamp: "Formatted at 2026-08-11 18:55:30 on dist-test-slave-68xk"
server_key: "370a21022208f7f7093fb75787e36928"
server_key_iv: "5722743dabcd985e3b515c8639da0a33"
server_key_version: "encryptionkey@0"
I20260811 18:55:30.556566 12829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:30.563171 12820 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } attempt: 2
I20260811 18:55:30.563699 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.563536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32890)
0811 18:55:30.563624 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.563668 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 18:55:30.564122 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.564041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32898)
0811 18:55:30.564083 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.564107 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 18:55:30.564251 12820 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:32891: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
I20260811 18:55:30.586301 12829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:30.587523 12683 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } attempt: 2
I20260811 18:55:30.588043 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.587882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32906)
0811 18:55:30.587957 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.588001 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 18:55:30.588454 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.588347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32912)
0811 18:55:30.588389 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.588421 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 18:55:30.588606 12683 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:32891: Network error: Client connection negotiation failed: client connection to 127.23.226.252:32891: connect: Connection refused (error 111)
I20260811 18:55:30.589131 12829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:30.589336 12829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:30.593680 12829 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.252:32891
I20260811 18:55:30.593745 12941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.252:32891 every 8 connection(s)
I20260811 18:55:30.594125 12829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
I20260811 18:55:30.595096 12942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:30.597023 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 12829
I20260811 18:55:30.597105 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786474364687722-24459-0/minicluster-data/master-2/wal/instance
I20260811 18:55:30.596903 12942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:55:30.597304 24459 external_mini_cluster.cc:1428] Setting key 1d200b280822dddd23159d7dadc94302
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:55:30.606941 12692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.597680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51012 (local address 127.23.226.254:33291)
0811 18:55:30.597736 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.597739 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.598035 (+ 296us) server_negotiation.cc:407] Connection header received
0811 18:55:30.598527 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.598528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.598543 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.598620 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.599205 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.599896 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.601255 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.601553 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.601633 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.603984 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.603986 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.603987 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.603995 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.605389 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.605856 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.605858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.605858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.605927 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.606172 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.606173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.606174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.606357 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.606465 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.606760 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.606851 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:55:30.607148 12944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.597688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:33291 (local address 127.0.0.1:51012)
0811 18:55:30.597889 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.597931 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.598384 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.598674 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.598677 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.598945 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.599115 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.599119 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.599978 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.599979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.601173 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.601175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.601652 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.601653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.601795 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.602402 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.602449 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.603889 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.605469 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.605477 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.605479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.605778 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.606001 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.606001 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.606002 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.606101 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.606476 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.606481 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.606595 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.606708 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.606879 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":199,"thread_start_us":134,"threads_started":1}
I20260811 18:55:30.607772 12947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.597723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32914 (local address 127.23.226.252:32891)
0811 18:55:30.598536 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.598541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.598705 (+ 164us) server_negotiation.cc:407] Connection header received
0811 18:55:30.598781 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.598784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.598819 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.598913 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.599664 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.600769 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.601638 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.602069 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.602122 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.604505 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.604511 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.604512 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.604518 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.606465 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.606811 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.606815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.606815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.606880 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.607127 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.607128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.607129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.607318 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.607449 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.607564 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.607640 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":92,"threads_started":1}
I20260811 18:55:30.607743 12942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:30.615103 12944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.608057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:36227 (local address 127.0.0.1:58640)
0811 18:55:30.608090 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.608100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.608142 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.608369 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.608370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.608542 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.608604 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.608606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.609302 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.609303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.609809 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.609810 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.610152 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.610153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.610225 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.610665 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.610669 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.612072 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.613984 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.613985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.613986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.614204 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.614455 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.614456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.614457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.614533 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.614853 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.614854 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.614895 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.614955 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.615034 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 18:55:30.615195 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.608162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58640 (local address 127.23.226.253:36227)
0811 18:55:30.608232 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.608234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.608243 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:55:30.608270 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.608273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.608287 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.608363 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.608671 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.609210 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.609893 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.610080 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.610133 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.612164 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.612166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.612166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.612172 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.613880 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.614285 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.614286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.614287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.614345 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.614624 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.614626 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.614626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.614773 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.614852 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.615005 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.615085 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 18:55:30.615585 12942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:55:30.616734 12692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.608594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51026 (local address 127.23.226.254:33291)
0811 18:55:30.608628 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.608630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.608638 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:55:30.608681 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.608681 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.608691 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.608760 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.609195 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.609682 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.610609 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.610846 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.610901 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.613548 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.613549 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.613550 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.613557 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.615522 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.615924 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.615926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.615926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.615982 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.616201 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.616202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.616202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.616323 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.616526 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.616564 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.616640 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:55:30.623040 12944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.615891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32922)
0811 18:55:30.615984 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.615996 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.616047 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.616200 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.616201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.616343 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.616370 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.616371 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.617226 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.617228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.617920 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.617923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.618323 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.618324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.618376 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.618861 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.618867 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.620215 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.621983 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.621984 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.621985 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.622151 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.622350 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.622351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.622351 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.622405 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.622679 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.622680 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.622719 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.622805 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.622909 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 18:55:30.623087 12947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.615941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32922 (local address 127.23.226.252:32891)
0811 18:55:30.615996 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.615999 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.616031 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:55:30.616096 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.616097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.616108 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.616197 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.616450 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.617142 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.618009 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.618242 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.618326 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.620293 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.620294 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.620295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.620302 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.621902 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.622224 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.622225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.622226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.622278 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.622497 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.622498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.622499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.622611 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.622687 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.622828 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.622961 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":39}
I20260811 18:55:30.624571 12942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376: Bootstrap starting.
I20260811 18:55:30.625522 12942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:30.625720 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.617694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58656 (local address 127.23.226.253:36227)
0811 18:55:30.617740 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.617742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.617750 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:55:30.617773 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.617774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.617783 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.617826 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.618301 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.618826 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.619693 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.619950 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.620053 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.622673 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.622674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.622675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.622682 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.624521 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.624895 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.624896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.624896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.624951 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.625171 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.625172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.625172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.625290 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.625494 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.625531 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.625606 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:55:30.625905 12942 log.cc:824] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:30.626777 12942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376: No bootstrap required, opened a new log
I20260811 18:55:30.627671 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:55:30.628986 12942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.629292 12942 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:30.629420 12942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9cbc57dc23487db2c131af60728376, State: Initialized, Role: FOLLOWER
I20260811 18:55:30.629747 12942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.630262 12942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:30.632108 12963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
W20260811 18:55:30.632282 12978 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 18:55:30.632292 12963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:55:30.632418 12978 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:55:30.632531 12829 master_runner.cc:186] Error getting master registration for 127.23.226.254:33291: OK, instance_id { permanent_uuid: "8715b36f70e643da8126f21bb191b407" instance_seqno: 1786474530242565 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:55:30.635176 12829 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:55:30.637952 12947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.629517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32924 (local address 127.23.226.252:32891)
0811 18:55:30.629561 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.629562 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.629573 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:55:30.629669 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.629670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.629679 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.629711 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.630511 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.631273 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.632714 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.632926 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.633007 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.634289 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.634291 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.634291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.634299 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.636445 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.636962 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.636963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.636964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.637029 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.637263 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.637264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.637265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.637447 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.637521 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.637753 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.637843 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:55:30.640507 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.629384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58664 (local address 127.23.226.253:36227)
0811 18:55:30.629428 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.629430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.629746 (+ 316us) server_negotiation.cc:407] Connection header received
0811 18:55:30.629819 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.629821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.629833 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.629888 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.630670 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.631403 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.635287 (+ 3884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.635511 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.635617 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.637465 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.637466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.637467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.637475 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.639371 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.639703 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.639704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.639704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.639771 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.639983 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.639984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.639984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.640100 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.640205 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.640308 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.640389 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:55:30.641486 12692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.629386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51028 (local address 127.23.226.254:33291)
0811 18:55:30.629428 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.629430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.629908 (+ 478us) server_negotiation.cc:407] Connection header received
0811 18:55:30.630007 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.630009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.630021 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.630052 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.630789 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.631482 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.635558 (+ 4076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.635839 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.635904 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.637493 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.637494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.637495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.637503 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.640138 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.640579 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.640580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.640581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.640660 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.640890 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.640891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.640891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.641029 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.641127 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.641208 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.641295 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:55:30.655412 12820 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } attempt: 3
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:55:30.662807 12947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.655797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32938 (local address 127.23.226.252:32891)
0811 18:55:30.655864 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.655866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.655876 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:55:30.655947 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.655948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.655958 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.656029 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.656360 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.656844 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.657517 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.657711 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.657796 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.660031 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.660032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.660033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.660047 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.661609 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.662007 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.662007 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.662008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.662069 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.662274 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.662274 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.662274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.662379 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.662501 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.662665 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.662740 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 18:55:30.662851 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.655720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32938)
0811 18:55:30.655805 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.655833 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.655882 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.656034 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.656035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.656212 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.656277 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.656279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.656935 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.656937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.657430 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.657432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.657795 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.657796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.657859 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.658332 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.658337 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.659919 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.661697 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.661698 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.661699 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.661929 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.662138 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.662139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.662139 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.662210 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.662503 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.662504 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.662557 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.662640 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.662744 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 18:55:30.664625 12820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb: Bootstrap starting.
I20260811 18:55:30.665350 12820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:30.665679 12820 log.cc:824] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:30.666543 12820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb: No bootstrap required, opened a new log
I20260811 18:55:30.668234 12820 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.668349 12820 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:30.668371 12820 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc2b119a3f64db49b922f18259538bb, State: Initialized, Role: FOLLOWER
I20260811 18:55:30.668526 12820 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.668907 12820 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:30.668859 12982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
I20260811 18:55:30.669057 12982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: This master's current role is: FOLLOWER
W20260811 18:55:30.670933 12995 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:55:30.671047 12995 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:55:30.671056 12698 master_runner.cc:186] Error getting master registration for 127.23.226.254:33291: OK, instance_id { permanent_uuid: "8715b36f70e643da8126f21bb191b407" instance_seqno: 1786474530242565 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:55:30.673344 12698 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:55:30.687822 12683 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } attempt: 3
Aug 11 18:55:30 dist-test-slave-68xk krb5kdc[12562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474530, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:55:30.696723 12947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.688365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32950 (local address 127.23.226.252:32891)
0811 18:55:30.688461 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:30.688463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:30.688470 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:55:30.688492 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:30.688493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:30.688562 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:30.688649 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:30.689144 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.689907 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.690939 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.691249 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.691327 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.693739 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:30.693740 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:30.693740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:30.693748 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:30.695430 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.695853 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.695854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.695854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.695918 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:30.696151 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:30.696152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:30.696153 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:30.696291 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:30.696359 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:30.696536 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 18:55:30.696625 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 18:55:30.696755 12687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:30.688154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:32891 (local address 127.0.0.1:32950)
0811 18:55:30.688243 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:30.688254 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:30.688293 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:30.688732 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:30.688734 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:30.688992 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:30.689044 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.689046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.690001 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.690003 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.690850 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:30.690853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:30.691339 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:30.691340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:30.691401 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:30.691934 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:30.691939 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:30.693647 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:30.695527 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.695528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.695528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.695769 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.696000 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:30.696001 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:30.696001 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:30.696095 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:30.696366 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:30.696367 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:30.696418 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 18:55:30.696493 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 18:55:30.696643 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 18:55:30.698719 12683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407: Bootstrap starting.
I20260811 18:55:30.699541 12683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:30.699893 12683 log.cc:824] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:30.700863 12683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407: No bootstrap required, opened a new log
I20260811 18:55:30.702983 12683 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.703132 12683 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:30.703171 12683 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8715b36f70e643da8126f21bb191b407, State: Initialized, Role: FOLLOWER
I20260811 18:55:30.703346 12683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.703696 12683 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:30.703647 12999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
W20260811 18:55:30.706313 13014 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:55:30.706487 13014 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:55:30.708647 12585 master_runner.cc:263] No leader master found from master 8715b36f70e643da8126f21bb191b407
I20260811 18:55:30.708704 12585 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:55:30.705896 12999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:55:30.710542 12982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:30.710700 12982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.711200 12651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc2b119a3f64db49b922f18259538bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8715b36f70e643da8126f21bb191b407" is_pre_election: true
I20260811 18:55:30.711344 12651 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc2b119a3f64db49b922f18259538bb in term 0.
I20260811 18:55:30.711639 12720 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc2b119a3f64db49b922f18259538bb, 8715b36f70e643da8126f21bb191b407; no voters:
I20260811 18:55:30.712105 12895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc2b119a3f64db49b922f18259538bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9cbc57dc23487db2c131af60728376" is_pre_election: true
I20260811 18:55:30.712239 12895 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc2b119a3f64db49b922f18259538bb in term 0.
I20260811 18:55:30.712468 12982 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8715b36f70e643da8126f21bb191b407 (127.23.226.254:33291), 2f9cbc57dc23487db2c131af60728376 (127.23.226.252:32891)
I20260811 18:55:30.712596 12982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:55:30.712692 12982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:55:30.712761 12982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:30.713718 12982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.714035 12651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc2b119a3f64db49b922f18259538bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8715b36f70e643da8126f21bb191b407"
I20260811 18:55:30.714104 12651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:30.715058 12651 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc2b119a3f64db49b922f18259538bb in term 1.
I20260811 18:55:30.715276 12720 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc2b119a3f64db49b922f18259538bb, 8715b36f70e643da8126f21bb191b407; no voters:
I20260811 18:55:30.715826 12895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6cc2b119a3f64db49b922f18259538bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f9cbc57dc23487db2c131af60728376"
I20260811 18:55:30.715909 12895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:30.716729 12895 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc2b119a3f64db49b922f18259538bb in term 1.
I20260811 18:55:30.716969 12982 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [CANDIDATE]: Term 1 election: Requested vote from peers 8715b36f70e643da8126f21bb191b407 (127.23.226.254:33291), 2f9cbc57dc23487db2c131af60728376 (127.23.226.252:32891)
I20260811 18:55:30.717085 12982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:30.717186 12982 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [term 1 LEADER]: Becoming Leader. State: Replica: 6cc2b119a3f64db49b922f18259538bb, State: Running, Role: LEADER
I20260811 18:55:30.717315 12982 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } }
I20260811 18:55:30.717839 12982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc2b119a3f64db49b922f18259538bb. Latest consensus state: current_term: 1 leader_uuid: "6cc2b119a3f64db49b922f18259538bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
I20260811 18:55:30.717978 12982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:30.718288 13019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:30.718549 13019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:30.720155 12895 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [term 1 FOLLOWER]: Refusing update from remote peer 6cc2b119a3f64db49b922f18259538bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:30.720587 13017 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:30.722056 12963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc2b119a3f64db49b922f18259538bb. Latest consensus state: current_term: 1 leader_uuid: "6cc2b119a3f64db49b922f18259538bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
I20260811 18:55:30.722168 12963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:55:30.722627 12651 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [term 1 FOLLOWER]: Refusing update from remote peer 6cc2b119a3f64db49b922f18259538bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:30.722978 13017 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:30.724184 12999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc2b119a3f64db49b922f18259538bb. Latest consensus state: current_term: 1 leader_uuid: "6cc2b119a3f64db49b922f18259538bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
I20260811 18:55:30.724279 12999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:55:30.726366 13017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6cc2b119a3f64db49b922f18259538bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
I20260811 18:55:30.726483 13017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:30.726527 13017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6cc2b119a3f64db49b922f18259538bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
I20260811 18:55:30.726568 13017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:30.727062 12999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6cc2b119a3f64db49b922f18259538bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
I20260811 18:55:30.727144 12999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:55:30.727555 12963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6cc2b119a3f64db49b922f18259538bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8715b36f70e643da8126f21bb191b407" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33291 } } peers { permanent_uuid: "6cc2b119a3f64db49b922f18259538bb" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 36227 } } peers { permanent_uuid: "2f9cbc57dc23487db2c131af60728376" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 32891 } } }
I20260811 18:55:30.727653 12963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:55:30.728006 13020 mvcc.cc:205] Tried to move back new op lower bound from 7317399677827448832 to 7317399677819142144. Current Snapshot: MvccSnapshot[applied={T|T < 7317399677827448832}]
I20260811 18:55:30.728230 13024 mvcc.cc:205] Tried to move back new op lower bound from 7317399677827448832 to 7317399677819142144. Current Snapshot: MvccSnapshot[applied={T|T < 7317399677827448832}]
I20260811 18:55:30.728909 13021 mvcc.cc:205] Tried to move back new op lower bound from 7317399677827448832 to 7317399677819142144. Current Snapshot: MvccSnapshot[applied={T|T < 7317399677827448832}]
I20260811 18:55:30.729800 13019 catalog_manager.cc:1347] Generated new cluster ID: e8680b8c02564a56b347cde16d921cc1
I20260811 18:55:30.729848 13019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:55:30.776444 13019 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:55:30.777328 13019 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:30.789328 13019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cc2b119a3f64db49b922f18259538bb: Generated new TSK 0
I20260811 18:55:30.789647 13019 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:55:31.632977 12978 catalog_manager.cc:1259] Loaded cluster ID: e8680b8c02564a56b347cde16d921cc1
I20260811 18:55:31.633095 12978 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376: loading cluster ID for follower catalog manager: success
I20260811 18:55:31.633949 12978 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376: acquiring CA information for follower catalog manager: success
I20260811 18:55:31.634281 12978 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2f9cbc57dc23487db2c131af60728376: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:55:31.707016 13014 catalog_manager.cc:1259] Loaded cluster ID: e8680b8c02564a56b347cde16d921cc1
I20260811 18:55:31.707108 13014 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407: loading cluster ID for follower catalog manager: success
I20260811 18:55:31.707911 13014 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407: acquiring CA information for follower catalog manager: success
I20260811 18:55:31.708170 13014 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8715b36f70e643da8126f21bb191b407: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:55:31.847957 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 12585
I20260811 18:55:31.859799 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 12698
I20260811 18:55:31.871133 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 12829
2026-08-11T18:55:31Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3181 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:55:31 dist-test-slave-68xk krb5kdc[13037](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:55:31 dist-test-slave-68xk krb5kdc[13037](info): set up 2 sockets
Aug 11 18:55:31 dist-test-slave-68xk krb5kdc[13037](info): commencing operation
krb5kdc: starting...
W20260811 18:55:33.162472 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:55:33 dist-test-slave-68xk krb5kdc[13037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:55:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:55:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:55:33.293160 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42323
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:37303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:42323
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:33.385944 13054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:33.386221 13054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:33.386264 13054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:33.387559 13054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:33.387637 13054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:33.387665 13054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:33.387688 13054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:33.387748 13054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:33.389411 13054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:37303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:42323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:33.389750 13054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:33.390033 13054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:33.395473 13066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:33.395644 13054 server_base.cc:1034] running on GCE node
W20260811 18:55:33.395455 13062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:33.395455 13063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:33.396014 13054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:33.396399 13054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:33.397599 13054 hybrid_clock.cc:648] HybridClock initialized: now 1786474533397575 us; error 44 us; skew 500 ppm
Aug 11 18:55:33 dist-test-slave-68xk krb5kdc[13037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474533, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:33.400322 13054 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:55:33.400789 13054 webserver.cc:460] Webserver started at http://127.23.226.254:33589/ using document root <none> and password file <none>
I20260811 18:55:33.401043 13054 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:33.401113 13054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:33.401268 13054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:33.402376 13054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "40c0b7df07d64d81806b8551baf03e9e"
format_stamp: "Formatted at 2026-08-11 18:55:33 on dist-test-slave-68xk"
server_key: "984e92b2c5e0df842042e6f224e7473f"
server_key_iv: "0110990c9ed586edff7c34eb82d3721e"
server_key_version: "encryptionkey@0"
I20260811 18:55:33.402844 13054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "40c0b7df07d64d81806b8551baf03e9e"
format_stamp: "Formatted at 2026-08-11 18:55:33 on dist-test-slave-68xk"
server_key: "984e92b2c5e0df842042e6f224e7473f"
server_key_iv: "0110990c9ed586edff7c34eb82d3721e"
server_key_version: "encryptionkey@0"
I20260811 18:55:33.404452 13054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:55:33.405400 13075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:33.405630 13054 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:33.405756 13054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "40c0b7df07d64d81806b8551baf03e9e"
format_stamp: "Formatted at 2026-08-11 18:55:33 on dist-test-slave-68xk"
server_key: "984e92b2c5e0df842042e6f224e7473f"
server_key_iv: "0110990c9ed586edff7c34eb82d3721e"
server_key_version: "encryptionkey@0"
I20260811 18:55:33.405838 13054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:33.421253 13054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:33.423602 13054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:33.423779 13054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:33.428195 13054 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:42323
I20260811 18:55:33.428242 13157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:42323 every 8 connection(s)
I20260811 18:55:33.428649 13054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:33.428946 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 13054
I20260811 18:55:33.429095 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:55:33.429358 24459 external_mini_cluster.cc:1428] Setting key b264b898efcaf5ae0a68ccd80ecd6d15
I20260811 18:55:33.429780 13159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:33.433342 13159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e: Bootstrap starting.
I20260811 18:55:33.434032 13159 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:33.434348 13159 log.cc:824] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:33.435370 13159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e: No bootstrap required, opened a new log
Aug 11 18:55:33 dist-test-slave-68xk krb5kdc[13037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:33.437608 13159 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40c0b7df07d64d81806b8551baf03e9e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42323 } }
I20260811 18:55:33.437777 13159 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:33.437829 13159 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40c0b7df07d64d81806b8551baf03e9e, State: Initialized, Role: FOLLOWER
I20260811 18:55:33.437994 13159 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40c0b7df07d64d81806b8551baf03e9e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42323 } }
I20260811 18:55:33.438094 13159 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:33.438133 13159 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:33.438177 13159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:33.438833 13159 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40c0b7df07d64d81806b8551baf03e9e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42323 } }
I20260811 18:55:33.438974 13159 leader_election.cc:302] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40c0b7df07d64d81806b8551baf03e9e; no voters:
I20260811 18:55:33.439167 13159 leader_election.cc:288] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:55:33.439265 13167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:33.439457 13159 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:33.439509 13167 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [term 1 LEADER]: Becoming Leader. State: Replica: 40c0b7df07d64d81806b8551baf03e9e, State: Running, Role: LEADER
I20260811 18:55:33.439695 13167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40c0b7df07d64d81806b8551baf03e9e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42323 } }
I20260811 18:55:33.440133 13169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40c0b7df07d64d81806b8551baf03e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40c0b7df07d64d81806b8551baf03e9e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42323 } } }
I20260811 18:55:33.440227 13169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:33.440472 13172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40c0b7df07d64d81806b8551baf03e9e. Latest consensus state: current_term: 1 leader_uuid: "40c0b7df07d64d81806b8551baf03e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40c0b7df07d64d81806b8551baf03e9e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42323 } } }
I20260811 18:55:33.440603 13172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:33.440793 13184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:33.441306 13184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:33.441553 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:33.429916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50562 (local address 127.23.226.254:42323)
0811 18:55:33.430094 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:33.430104 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:33.430142 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:55:33.430672 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:33.430680 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:33.430729 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:33.430847 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:33.431734 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:33.432635 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:33.433692 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:33.434194 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:33.434322 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:33.437124 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:33.437129 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:33.437129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:33.437141 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:33.439212 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:33.439710 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:33.439713 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:33.439713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:33.439822 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:33.440079 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:33.440081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:33.440082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:33.440436 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:33.440626 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:33.441155 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 18:55:33.441321 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":94,"threads_started":1}
I20260811 18:55:33.442662 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:55:33.443521 13184 catalog_manager.cc:1347] Generated new cluster ID: 874e33afe5ae4415b3a65ce82063f640
I20260811 18:55:33.443575 13184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:55:33.476286 13184 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:55:33.477037 13184 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:33.480931 13184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40c0b7df07d64d81806b8551baf03e9e: Generated new TSK 0
I20260811 18:55:33.481104 13184 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:55:33.496830 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 13054
2026-08-11T18:55:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1626 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:55:33 dist-test-slave-68xk krb5kdc[13211](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:55:33 dist-test-slave-68xk krb5kdc[13211](info): set up 2 sockets
Aug 11 18:55:33 dist-test-slave-68xk krb5kdc[13211](info): commencing operation
krb5kdc: starting...
W20260811 18:55:34.745687 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:55:34 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:55:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:55:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:55:34.885417 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42519
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:42519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:34.969816 13230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:34.970026 13230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:34.970047 13230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:34.971243 13230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:34.971287 13230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:34.971302 13230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:34.971315 13230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:34.971365 13230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:34.972890 13230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:42519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:34.973141 13230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:34.973381 13230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:34.978399 13237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:34.978571 13236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:34.978376 13241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:34.980002 13230 server_base.cc:1034] running on GCE node
I20260811 18:55:34.980278 13230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:34.980613 13230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:34.981761 13230 hybrid_clock.cc:648] HybridClock initialized: now 1786474534981740 us; error 43 us; skew 500 ppm
Aug 11 18:55:34 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474534, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:34.984385 13230 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:55:34.984889 13230 webserver.cc:460] Webserver started at http://127.23.226.254:38905/ using document root <none> and password file <none>
I20260811 18:55:34.985139 13230 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:34.985211 13230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:34.985359 13230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:34.986397 13230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "2f5c2738665e42538955580618b56e6c"
format_stamp: "Formatted at 2026-08-11 18:55:34 on dist-test-slave-68xk"
server_key: "379b06db2446be7cec425ca9fcdffa38"
server_key_iv: "32de08a32a876756e192a620ec025ce1"
server_key_version: "encryptionkey@0"
I20260811 18:55:34.986832 13230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "2f5c2738665e42538955580618b56e6c"
format_stamp: "Formatted at 2026-08-11 18:55:34 on dist-test-slave-68xk"
server_key: "379b06db2446be7cec425ca9fcdffa38"
server_key_iv: "32de08a32a876756e192a620ec025ce1"
server_key_version: "encryptionkey@0"
I20260811 18:55:34.988229 13230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:34.989019 13250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:34.989223 13230 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:34.989334 13230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "2f5c2738665e42538955580618b56e6c"
format_stamp: "Formatted at 2026-08-11 18:55:34 on dist-test-slave-68xk"
server_key: "379b06db2446be7cec425ca9fcdffa38"
server_key_iv: "32de08a32a876756e192a620ec025ce1"
server_key_version: "encryptionkey@0"
I20260811 18:55:34.989421 13230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:35.003571 13230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:35.006290 13230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:35.006488 13230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:35.012133 13230 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:42519
I20260811 18:55:35.012185 13329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:42519 every 8 connection(s)
I20260811 18:55:35.012609 13230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:35.014005 13330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:35.016937 13330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Bootstrap starting.
I20260811 18:55:35.017552 13330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:35.017853 13330 log.cc:824] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:35.018666 13330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: No bootstrap required, opened a new log
I20260811 18:55:35.020315 13330 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:35.020474 13330 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:35.020524 13330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f5c2738665e42538955580618b56e6c, State: Initialized, Role: FOLLOWER
I20260811 18:55:35.020666 13330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:35.020751 13330 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:35.020795 13330 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:35.020846 13330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:35.021034 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 13230
I20260811 18:55:35.021160 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:55:35.021394 24459 external_mini_cluster.cc:1428] Setting key 1db12cf10e6c9456c6687683d6f5d012
I20260811 18:55:35.021768 13330 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:35.021890 13330 leader_election.cc:302] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f5c2738665e42538955580618b56e6c; no voters:
I20260811 18:55:35.022038 13330 leader_election.cc:288] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:55:35.022214 13341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:35.022308 13330 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:35.022331 13341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 1 LEADER]: Becoming Leader. State: Replica: 2f5c2738665e42538955580618b56e6c, State: Running, Role: LEADER
I20260811 18:55:35.022439 13341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:35.022850 13341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5c2738665e42538955580618b56e6c. Latest consensus state: current_term: 1 leader_uuid: "2f5c2738665e42538955580618b56e6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } } }
I20260811 18:55:35.022951 13341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:35.022861 13339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f5c2738665e42538955580618b56e6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } } }
I20260811 18:55:35.023124 13339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: This master's current role is: LEADER
W20260811 18:55:35.024278 13367 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:55:35.024338 13367 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:55:35.024590 13355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:35.024752 13355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:35.026221 13355 catalog_manager.cc:1347] Generated new cluster ID: b7e1819f1a884809b3d0302e6a4a9f12
I20260811 18:55:35.026274 13355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:55:35 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:35.033133 13338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.021916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34604 (local address 127.23.226.254:42519)
0811 18:55:35.022097 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.022108 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.022143 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:55:35.022259 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.022285 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.022346 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.022519 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:35.023479 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.024898 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.025677 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.026264 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.026374 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.029382 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:35.029387 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:35.029387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:35.029399 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:35.031447 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.031876 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.031879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.031879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.032005 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.032235 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.032236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.032237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.032520 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:35.032673 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.032809 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.032939 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
I20260811 18:55:35.052481 13355 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:55:35.053031 13355 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:35.059098 13355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Generated new TSK 0
I20260811 18:55:35.059345 13355 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:55:35.097386 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42519
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:35.182554 13379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:35.182749 13379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:35.182771 13379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:35.183846 13379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:35.183880 13379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:35.183907 13379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:55:35.185276 13379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:35.185451 13379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:35.185621 13379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:35.190771 13387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:35.190850 13379 server_base.cc:1034] running on GCE node
W20260811 18:55:35.190783 13385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:35.190802 13384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:35.191272 13379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:35.191480 13379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:35.192615 13379 hybrid_clock.cc:648] HybridClock initialized: now 1786474535192603 us; error 32 us; skew 500 ppm
Aug 11 18:55:35 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474535, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:35.195506 13379 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:55:35.195955 13379 webserver.cc:460] Webserver started at http://127.23.226.193:45289/ using document root <none> and password file <none>
I20260811 18:55:35.196193 13379 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:35.196239 13379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:35.196367 13379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:35.197424 13379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "f0ce440602fe478aa69b3b2fb31a29d1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "af25a4b1be85b9ae97c8a83aebfeae69"
server_key_iv: "fca651ba96bfbf45dc3c56a3f09241d6"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.197830 13379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "f0ce440602fe478aa69b3b2fb31a29d1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "af25a4b1be85b9ae97c8a83aebfeae69"
server_key_iv: "fca651ba96bfbf45dc3c56a3f09241d6"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.199327 13379 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:55:35.200155 13399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.200359 13379 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:35.200449 13379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "f0ce440602fe478aa69b3b2fb31a29d1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "af25a4b1be85b9ae97c8a83aebfeae69"
server_key_iv: "fca651ba96bfbf45dc3c56a3f09241d6"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.200503 13379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:35.246258 13379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:35.248791 13379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:35.248906 13379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:35.249120 13379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:35.249462 13379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:35.249498 13379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.249522 13379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:35.249572 13379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.255616 13379 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:43547
I20260811 18:55:35.255668 13583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:43547 every 8 connection(s)
I20260811 18:55:35.256016 13379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:55:35 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474535, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:35.263618 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 13379
I20260811 18:55:35.263736 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:55:35.263902 24459 external_mini_cluster.cc:1428] Setting key 850f8e9b94af9384bde28210c1d48443
I20260811 18:55:35.266072 13338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.256833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:34313 (local address 127.23.226.254:42519)
0811 18:55:35.256899 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.256902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.257143 (+ 241us) server_negotiation.cc:407] Connection header received
0811 18:55:35.257613 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.257615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.257628 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.257690 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:35.258678 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.259186 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.260234 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.260452 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.260509 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.262791 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:35.262793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:35.262793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:35.262805 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:35.264477 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.265063 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.265065 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.265065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.265124 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.265424 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.265425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.265425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.265530 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:35.265583 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.265918 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.265998 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:55:35.266381 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.256765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:34313)
0811 18:55:35.256979 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.257018 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:35.257532 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:35.257746 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:35.257749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:35.258352 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:35.258585 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.258590 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.259305 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.259306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.260146 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.260149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.260545 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.260546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.260696 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.261165 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:35.261174 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:35.262683 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:35.264578 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:35.264586 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:35.264589 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:35.264949 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:35.265198 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:35.265199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:35.265199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:35.265358 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:35.265596 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:35.265602 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:35.265784 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 18:55:35.265896 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 18:55:35.266080 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":69,"threads_started":1}
I20260811 18:55:35.267016 13586 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42519
I20260811 18:55:35.267119 13586 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:35.267338 13586 heartbeater.cc:511] Master 127.23.226.254:42519 requested a full tablet report, sending...
I20260811 18:55:35.267949 13274 ts_manager.cc:194] Registered new tserver with Master: f0ce440602fe478aa69b3b2fb31a29d1 (127.23.226.193:43547)
I20260811 18:55:35.268577 13274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:34313
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:55:35.294238 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42519
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:35.381397 13594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:35.381611 13594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:35.381636 13594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:35.382841 13594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:35.382885 13594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:35.382912 13594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:55:35.384327 13594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:35.384517 13594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:35.384712 13594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:35.390015 13604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:35.390329 13594 server_base.cc:1034] running on GCE node
W20260811 18:55:35.390024 13603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:35.390015 13607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:35.390704 13594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:35.391013 13594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:35.392210 13594 hybrid_clock.cc:648] HybridClock initialized: now 1786474535392217 us; error 61 us; skew 500 ppm
Aug 11 18:55:35 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474535, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:35.395531 13594 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:55:35.396171 13594 webserver.cc:460] Webserver started at http://127.23.226.194:36471/ using document root <none> and password file <none>
I20260811 18:55:35.396459 13594 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:35.396536 13594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:35.396697 13594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:35.397871 13594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "c01599178e8c4aaab51e2beb1b197bb1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "261939a4b636ca28530fdc52c3c32f8e"
server_key_iv: "686ab2ae9f90a215c0e28e78e57b2ae0"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.398285 13594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "c01599178e8c4aaab51e2beb1b197bb1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "261939a4b636ca28530fdc52c3c32f8e"
server_key_iv: "686ab2ae9f90a215c0e28e78e57b2ae0"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.399873 13594 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:35.400827 13615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.401131 13594 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:35.401273 13594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "c01599178e8c4aaab51e2beb1b197bb1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "261939a4b636ca28530fdc52c3c32f8e"
server_key_iv: "686ab2ae9f90a215c0e28e78e57b2ae0"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.401369 13594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:35.417606 13594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:35.420423 13594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:35.420621 13594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:35.420909 13594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:35.421322 13594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:35.421386 13594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.421437 13594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:35.421464 13594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.428576 13594 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:35751
I20260811 18:55:35.428694 13798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:35751 every 8 connection(s)
I20260811 18:55:35.429044 13594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:35.431063 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 13594
I20260811 18:55:35.431185 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:55:35.431406 24459 external_mini_cluster.cc:1428] Setting key 0c33138e9c1ce0027925f678e9e905a4
Aug 11 18:55:35 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474535, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:35.439777 13338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.429893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:60963 (local address 127.23.226.254:42519)
0811 18:55:35.429985 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.429988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.430177 (+ 189us) server_negotiation.cc:407] Connection header received
0811 18:55:35.430797 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.430798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.430808 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.430869 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:35.432217 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.432917 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.434004 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.434295 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.434353 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.436839 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:35.436841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:35.436842 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:35.436850 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:35.438303 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.438770 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.438771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.438771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.438834 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.439104 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.439105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.439105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.439229 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:35.439307 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.439595 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.439684 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:55:35.439977 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.429844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:60963)
0811 18:55:35.430043 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.430081 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:35.430672 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:35.430985 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:35.430990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:35.431824 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:35.432091 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.432098 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.433023 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.433024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.433898 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.433901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.434388 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.434389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.434561 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.435107 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:35.435119 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:35.436737 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:35.438436 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:35.438443 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:35.438446 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:35.438686 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:35.438914 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:35.438914 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:35.438915 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:35.439027 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:35.439298 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:35.439307 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:35.439455 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 18:55:35.439559 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 18:55:35.439733 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":106,"threads_started":1}
I20260811 18:55:35.440477 13799 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42519
I20260811 18:55:35.440578 13799 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:35.440785 13799 heartbeater.cc:511] Master 127.23.226.254:42519 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
I20260811 18:55:35.441208 13274 ts_manager.cc:194] Registered new tserver with Master: c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751)
I20260811 18:55:35.441584 13274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:60963
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:55:35.461232 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42519
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:35.545524 13807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:35.545737 13807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:35.545760 13807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:35.546923 13807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:35.546963 13807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:35.546990 13807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:55:35.548446 13807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:35.548704 13807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:35.548949 13807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:35.554162 13825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:35.554193 13818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:35.554174 13820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:35.554502 13807 server_base.cc:1034] running on GCE node
I20260811 18:55:35.554723 13807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:35.554996 13807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:35.556182 13807 hybrid_clock.cc:648] HybridClock initialized: now 1786474535556166 us; error 27 us; skew 500 ppm
Aug 11 18:55:35 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474535, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:35.558851 13807 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:55:35.559374 13807 webserver.cc:460] Webserver started at http://127.23.226.195:33565/ using document root <none> and password file <none>
I20260811 18:55:35.559652 13807 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:35.559725 13807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:35.559888 13807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:35.560987 13807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "890e7f75c1a747d694faf59c1afab0ef"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "825b80ed07aa1a73795a26ffe4460954"
server_key_iv: "6ccee263248bf6017afe1a041bd7a522"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.561372 13807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "890e7f75c1a747d694faf59c1afab0ef"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "825b80ed07aa1a73795a26ffe4460954"
server_key_iv: "6ccee263248bf6017afe1a041bd7a522"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.562821 13807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:55:35.563730 13832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.563915 13807 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:35.564023 13807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "890e7f75c1a747d694faf59c1afab0ef"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "825b80ed07aa1a73795a26ffe4460954"
server_key_iv: "6ccee263248bf6017afe1a041bd7a522"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.564095 13807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:35.590975 13807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:35.593447 13807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:35.593611 13807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:35.593888 13807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:35.594218 13807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:35.594274 13807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.594321 13807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:35.594349 13807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.600894 13807 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:44501
I20260811 18:55:35.600941 14008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:44501 every 8 connection(s)
I20260811 18:55:35.601266 13807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:35.606963 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 13807
I20260811 18:55:35.607054 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:55:35.607225 24459 external_mini_cluster.cc:1428] Setting key a871aac72d80305953700cd5ce6c237e
Aug 11 18:55:35 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474535, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:35.612006 13338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.602042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:48193 (local address 127.23.226.254:42519)
0811 18:55:35.602090 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.602093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.602287 (+ 194us) server_negotiation.cc:407] Connection header received
0811 18:55:35.602986 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.602988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.603000 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.603065 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:35.604340 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.605097 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.606193 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.606378 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.606459 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.609311 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:35.609313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:35.609313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:35.609319 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:35.610810 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.611196 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.611197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.611197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.611252 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.611474 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.611475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.611475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.611576 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:35.611627 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.611878 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.611942 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:55:35.612191 14014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.601990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:48193)
0811 18:55:35.602161 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.602203 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:35.602870 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:35.603142 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:35.603146 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:35.603907 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:35.604226 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.604233 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.605183 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.605184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.606106 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.606109 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.606484 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.606485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.606593 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.607205 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:35.607214 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:35.609217 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:35.610883 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:35.610890 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:35.610892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:35.611124 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:35.611315 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:35.611315 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:35.611316 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:35.611418 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:35.611631 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:35.611636 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:35.611764 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 18:55:35.611846 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:55:35.611963 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260811 18:55:35.612736 14011 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42519
I20260811 18:55:35.612838 14011 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:35.613006 14011 heartbeater.cc:511] Master 127.23.226.254:42519 requested a full tablet report, sending...
I20260811 18:55:35.613395 13274 ts_manager.cc:194] Registered new tserver with Master: 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501)
I20260811 18:55:35.613782 13274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:48193
I20260811 18:55:35.619109 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:55:35.626639 13338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.620451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34606 (local address 127.23.226.254:42519)
0811 18:55:35.620526 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.620528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.620670 (+ 142us) server_negotiation.cc:407] Connection header received
0811 18:55:35.620736 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.620737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.620748 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.620798 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:35.621397 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.621868 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.622681 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.622906 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.622986 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.624249 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:35.624251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:35.624252 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:35.624259 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:35.625425 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.625799 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.625800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.625801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.625861 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:35.626070 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:35.626071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:35.626072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:35.626225 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:35.626333 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.626456 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.626539 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 18:55:35.628077 13274 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:55:35.629611 13274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:55:35.636351 14027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.632152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:35751 (local address 127.0.0.1:35546)
0811 18:55:35.632985 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.632995 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:35.633058 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:35.633232 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:35.633233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:35.633235 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:35.633281 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.633283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.634406 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.634432 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.635342 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.635344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.636029 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.636030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.636110 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.636124 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 18:55:35.636220 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 18:55:35.636274 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"thread_start_us":86,"threads_started":1}
I20260811 18:55:35.636366 14032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.632422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35546 (local address 127.23.226.194:35751)
0811 18:55:35.632589 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.632593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.633068 (+ 475us) server_negotiation.cc:407] Connection header received
0811 18:55:35.633117 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.633119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.633136 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.633218 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:35.633341 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.634271 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.635441 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.635932 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.636019 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.636078 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.636238 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.636286 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260811 18:55:35.636674 14028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.631943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:43547 (local address 127.0.0.1:50970)
0811 18:55:35.632315 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.632357 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:35.632442 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:35.632712 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:35.632715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:35.632717 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:35.632781 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.632783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.634048 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.634049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.635387 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.635391 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.636388 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.636390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.636476 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.636482 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 18:55:35.636532 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 18:55:35.636584 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":60,"thread_start_us":62,"threads_started":1}
I20260811 18:55:35.636776 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.632143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56410 (local address 127.23.226.195:44501)
0811 18:55:35.632366 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.632371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.632484 (+ 113us) server_negotiation.cc:407] Connection header received
0811 18:55:35.632656 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.632659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.632678 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.632754 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:35.632971 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.633826 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.635501 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.636227 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.636297 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.636348 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.636630 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.636685 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":107,"threads_started":1}
I20260811 18:55:35.636921 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.631943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:44501 (local address 127.0.0.1:56410)
0811 18:55:35.632406 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.632417 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:35.632496 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:35.632834 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:35.632835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:35.632838 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:35.632897 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.632899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.633931 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.633932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.635411 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.635413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.636390 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.636390 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.636476 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.636481 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:55:35.636532 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 18:55:35.636584 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":92,"thread_start_us":82,"threads_started":1}
I20260811 18:55:35.637236 13693 tablet_service.cc:1467] Processing CreateTablet for tablet 6127210353e647359792dda2a25b72d6 (DEFAULT_TABLE table=test-table [id=142df23abab54429a8e779f60ce19ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:35.637638 13693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6127210353e647359792dda2a25b72d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:35.637602 13908 tablet_service.cc:1467] Processing CreateTablet for tablet 6127210353e647359792dda2a25b72d6 (DEFAULT_TABLE table=test-table [id=142df23abab54429a8e779f60ce19ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:35.637914 13908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6127210353e647359792dda2a25b72d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:35.638665 14029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.632074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.23.226.193:43547)
0811 18:55:35.632307 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.632313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.632441 (+ 128us) server_negotiation.cc:407] Connection header received
0811 18:55:35.632576 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.632579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.632595 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.632690 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:35.632843 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.633941 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.635501 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.636220 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.636297 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.636348 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.638529 (+ 2181us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.638581 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":122,"threads_started":1}
I20260811 18:55:35.639293 13469 tablet_service.cc:1467] Processing CreateTablet for tablet 6127210353e647359792dda2a25b72d6 (DEFAULT_TABLE table=test-table [id=142df23abab54429a8e779f60ce19ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:35.639644 13469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6127210353e647359792dda2a25b72d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:35.640710 14035 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: Bootstrap starting.
I20260811 18:55:35.641270 14036 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Bootstrap starting.
I20260811 18:55:35.641460 14035 tablet_bootstrap.cc:654] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:35.641934 14035 log.cc:824] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:35.641978 14036 tablet_bootstrap.cc:654] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:35.642603 14036 log.cc:824] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:35.642714 14035 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: No bootstrap required, opened a new log
I20260811 18:55:35.642786 14035 ts_tablet_manager.cc:1397] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:55:35.643146 14042 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Bootstrap starting.
I20260811 18:55:35.643720 14042 tablet_bootstrap.cc:654] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:35.644151 14042 log.cc:824] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:35.644470 14035 raft_consensus.cc:348] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.644651 14035 raft_consensus.cc:374] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:35.644704 14035 raft_consensus.cc:729] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890e7f75c1a747d694faf59c1afab0ef, State: Initialized, Role: FOLLOWER
I20260811 18:55:35.644821 14035 consensus_queue.cc:260] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.644903 14042 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: No bootstrap required, opened a new log
I20260811 18:55:35.644977 14042 ts_tablet_manager.cc:1397] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:55:35.645112 14035 ts_tablet_manager.cc:1428] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:55:35.645190 14011 heartbeater.cc:503] Master 127.23.226.254:42519 was elected leader, sending a full tablet report...
I20260811 18:55:35.645802 14036 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: No bootstrap required, opened a new log
I20260811 18:55:35.645874 14036 ts_tablet_manager.cc:1397] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 18:55:35.647018 14042 raft_consensus.cc:348] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.647169 14042 raft_consensus.cc:374] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:35.647203 14042 raft_consensus.cc:729] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ce440602fe478aa69b3b2fb31a29d1, State: Initialized, Role: FOLLOWER
I20260811 18:55:35.647321 14042 consensus_queue.cc:260] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.647589 14042 ts_tablet_manager.cc:1428] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:35.647635 13586 heartbeater.cc:503] Master 127.23.226.254:42519 was elected leader, sending a full tablet report...
I20260811 18:55:35.647923 14036 raft_consensus.cc:348] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.648070 14036 raft_consensus.cc:374] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:35.648095 14036 raft_consensus.cc:729] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c01599178e8c4aaab51e2beb1b197bb1, State: Initialized, Role: FOLLOWER
I20260811 18:55:35.648216 14036 consensus_queue.cc:260] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.648506 14036 ts_tablet_manager.cc:1428] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:35.648531 13799 heartbeater.cc:503] Master 127.23.226.254:42519 was elected leader, sending a full tablet report...
W20260811 18:55:35.679704 13800 tablet.cc:2369] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:55:35.756784 13590 tablet.cc:2369] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:55:35.776963 14049 raft_consensus.cc:482] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:35.777122 14049 raft_consensus.cc:504] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.777590 14049 leader_election.cc:288] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501), c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751)
I20260811 18:55:35.780809 14055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.777730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:44501 (local address 127.23.226.193:39761)
0811 18:55:35.777905 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.777915 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:35.777990 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:35.778184 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:35.778185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:35.778188 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:35.778272 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.778275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.779049 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.779050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.779870 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.779873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.780550 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.780552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.780627 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.780632 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:55:35.780690 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 18:55:35.780732 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":85,"threads_started":1}
I20260811 18:55:35.780839 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.777832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:39761 (local address 127.23.226.195:44501)
0811 18:55:35.777883 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.777885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.777980 (+ 95us) server_negotiation.cc:407] Connection header received
0811 18:55:35.778068 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.778070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.778100 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.778163 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:35.778355 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.778957 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.779966 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.780456 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.780517 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.780525 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.780706 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.780746 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:55:35.781010 14032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.777940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:47409 (local address 127.23.226.194:35751)
0811 18:55:35.777994 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.777996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.778148 (+ 152us) server_negotiation.cc:407] Connection header received
0811 18:55:35.778181 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.778183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.778192 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.778254 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:35.778509 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.778983 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.780154 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.780586 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.780673 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.780683 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.780875 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.780925 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:55:35.781243 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.777843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:35751 (local address 127.23.226.193:47409)
0811 18:55:35.778021 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.778042 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:35.778126 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:35.778273 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:35.778274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:35.778275 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:35.778386 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.778388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.779101 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.779102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.780009 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:35.780011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.780699 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.780700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:35.780787 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.780791 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:55:35.780856 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 18:55:35.781149 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
I20260811 18:55:35.781175 13938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6127210353e647359792dda2a25b72d6" candidate_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890e7f75c1a747d694faf59c1afab0ef" is_pre_election: true
I20260811 18:55:35.781368 13938 raft_consensus.cc:2454] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ce440602fe478aa69b3b2fb31a29d1 in term 0.
I20260811 18:55:35.781626 13406 leader_election.cc:302] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 890e7f75c1a747d694faf59c1afab0ef, f0ce440602fe478aa69b3b2fb31a29d1; no voters:
I20260811 18:55:35.781659 13722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6127210353e647359792dda2a25b72d6" candidate_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c01599178e8c4aaab51e2beb1b197bb1" is_pre_election: true
I20260811 18:55:35.781787 14049 raft_consensus.cc:2781] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:55:35.781821 13722 raft_consensus.cc:2454] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ce440602fe478aa69b3b2fb31a29d1 in term 0.
I20260811 18:55:35.781859 14049 raft_consensus.cc:482] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:55:35.781894 14049 raft_consensus.cc:3037] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:35.782713 14049 raft_consensus.cc:504] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.782874 14049 leader_election.cc:288] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 1 election: Requested vote from peers 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501), c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751)
I20260811 18:55:35.783039 13722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6127210353e647359792dda2a25b72d6" candidate_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c01599178e8c4aaab51e2beb1b197bb1"
I20260811 18:55:35.783063 13938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6127210353e647359792dda2a25b72d6" candidate_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890e7f75c1a747d694faf59c1afab0ef"
I20260811 18:55:35.783118 13722 raft_consensus.cc:3037] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:35.783175 13938 raft_consensus.cc:3037] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:35.783908 13722 raft_consensus.cc:2454] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ce440602fe478aa69b3b2fb31a29d1 in term 1.
I20260811 18:55:35.783975 13938 raft_consensus.cc:2454] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ce440602fe478aa69b3b2fb31a29d1 in term 1.
I20260811 18:55:35.784123 13407 leader_election.cc:302] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c01599178e8c4aaab51e2beb1b197bb1, f0ce440602fe478aa69b3b2fb31a29d1; no voters:
I20260811 18:55:35.784220 14049 raft_consensus.cc:2781] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:35.784364 14049 raft_consensus.cc:686] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 LEADER]: Becoming Leader. State: Replica: f0ce440602fe478aa69b3b2fb31a29d1, State: Running, Role: LEADER
I20260811 18:55:35.784474 14049 consensus_queue.cc:237] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:35.785293 13274 catalog_manager.cc:5495] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ce440602fe478aa69b3b2fb31a29d1 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } health_report { overall_health: UNKNOWN } } }
I20260811 18:55:35.818413 14029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.815929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50986 (local address 127.23.226.193:43547)
0811 18:55:35.816007 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:35.816010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:35.816020 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:55:35.816065 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:35.816066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:35.816086 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:35.816169 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:55:35.816317 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.816798 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.817599 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:35.817815 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:35.817895 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:35.818068 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:55:35.818174 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:55:35.818274 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:35.818297 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 18:55:35.818319 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:55:35.820556 13938 raft_consensus.cc:1261] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 1 FOLLOWER]: Refusing update from remote peer f0ce440602fe478aa69b3b2fb31a29d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:35.820554 13722 raft_consensus.cc:1261] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 1 FOLLOWER]: Refusing update from remote peer f0ce440602fe478aa69b3b2fb31a29d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:35.820952 14057 consensus_queue.cc:1035] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:35.821110 14049 consensus_queue.cc:1035] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:35.824306 14066 mvcc.cc:205] Tried to move back new op lower bound from 7317399698717794304 to 7317399698573856768. Current Snapshot: MvccSnapshot[applied={T|T < 7317399698717794304}]
I20260811 18:55:35.826352 13274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:35.826489 13274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:35.827306 13274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Sending DeleteTablet for 3 replicas of tablet 6127210353e647359792dda2a25b72d6
I20260811 18:55:35.827675 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 13379
I20260811 18:55:35.827687 13908 tablet_service.cc:1514] Processing DeleteTablet for tablet 6127210353e647359792dda2a25b72d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:35 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:56410
I20260811 18:55:35.827741 13469 tablet_service.cc:1514] Processing DeleteTablet for tablet 6127210353e647359792dda2a25b72d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:35 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:50970
I20260811 18:55:35.827790 13693 tablet_service.cc:1514] Processing DeleteTablet for tablet 6127210353e647359792dda2a25b72d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:35 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:35546
I20260811 18:55:35.834899 14079 tablet_replica.cc:330] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: stopping tablet replica
I20260811 18:55:35.834899 14077 tablet_replica.cc:330] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: stopping tablet replica
I20260811 18:55:35.835063 14077 raft_consensus.cc:2229] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:35.835062 14079 raft_consensus.cc:2229] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:35.835191 14077 raft_consensus.cc:2258] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:35.835191 14079 raft_consensus.cc:2258] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:35.835747 14079 ts_tablet_manager.cc:1905] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:35.835747 14077 ts_tablet_manager.cc:1905] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:35.837563 14079 ts_tablet_manager.cc:1918] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:35.837563 14077 ts_tablet_manager.cc:1918] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:35.837658 14077 log.cc:1196] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/6127210353e647359792dda2a25b72d6
I20260811 18:55:35.837658 14079 log.cc:1196] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/6127210353e647359792dda2a25b72d6
I20260811 18:55:35.837978 14079 ts_tablet_manager.cc:1939] T 6127210353e647359792dda2a25b72d6 P c01599178e8c4aaab51e2beb1b197bb1: Deleting consensus metadata
I20260811 18:55:35.837998 14077 ts_tablet_manager.cc:1939] T 6127210353e647359792dda2a25b72d6 P 890e7f75c1a747d694faf59c1afab0ef: Deleting consensus metadata
I20260811 18:55:35.838495 13254 catalog_manager.cc:4841] TS c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751): tablet 6127210353e647359792dda2a25b72d6 (table test-table [id=142df23abab54429a8e779f60ce19ada]) successfully deleted
I20260811 18:55:35.838546 13253 catalog_manager.cc:4841] TS 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501): tablet 6127210353e647359792dda2a25b72d6 (table test-table [id=142df23abab54429a8e779f60ce19ada]) successfully deleted
W20260811 18:55:35.842034 13254 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:43547 (error 108)
I20260811 18:55:35.842687 14028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:35.842521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:43547 (local address 127.0.0.1:50994)
0811 18:55:35.842588 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:35.842637 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:43547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 18:55:35.842702 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 13594
W20260811 18:55:35.842823 13254 catalog_manager.cc:4584] TS f0ce440602fe478aa69b3b2fb31a29d1 (127.23.226.193:43547): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6127210353e647359792dda2a25b72d6: Network error: Client connection negotiation failed: client connection to 127.23.226.193:43547: connect: Connection refused (error 111)
I20260811 18:55:35.853096 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 13807
I20260811 18:55:35.865777 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 13230
I20260811 18:55:35.875015 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42519
--webserver_interface=127.23.226.254
--webserver_port=38905
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:42519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:35.959988 14081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:35.960263 14081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:35.960304 14081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:35.961473 14081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:35.961546 14081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:35.961570 14081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:35.961589 14081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:35.961619 14081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:35.963202 14081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:42519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=38905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:35.963495 14081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:35.963744 14081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:35.973520 14093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:35.973531 14090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:35.973809 14081 server_base.cc:1034] running on GCE node
W20260811 18:55:35.973531 14088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:35.974135 14081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:35.974531 14081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:35.975724 14081 hybrid_clock.cc:648] HybridClock initialized: now 1786474535975720 us; error 39 us; skew 500 ppm
Aug 11 18:55:35 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474535, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:35.978521 14081 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:55:35.979063 14081 webserver.cc:460] Webserver started at http://127.23.226.254:38905/ using document root <none> and password file <none>
I20260811 18:55:35.979326 14081 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:35.979429 14081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:35.980957 14081 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:35.981784 14103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:35.982029 14081 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:35.982169 14081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "2f5c2738665e42538955580618b56e6c"
format_stamp: "Formatted at 2026-08-11 18:55:34 on dist-test-slave-68xk"
server_key: "379b06db2446be7cec425ca9fcdffa38"
server_key_iv: "32de08a32a876756e192a620ec025ce1"
server_key_version: "encryptionkey@0"
I20260811 18:55:35.982703 14081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:36.005033 14081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:36.007592 14081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:36.007817 14081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:36.012856 14081 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:42519
I20260811 18:55:36.012900 14186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:42519 every 8 connection(s)
I20260811 18:55:36.013391 14081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:36.015372 14188 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:55:36.016156 14188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Bootstrap starting.
I20260811 18:55:36.021332 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 14081
I20260811 18:55:36.021708 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:43547
--local_ip_for_outbound_sockets=127.23.226.193
--tserver_master_addrs=127.23.226.254:42519
--webserver_port=45289
--webserver_interface=127.23.226.193
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:36.027076 14188 log.cc:824] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:36.029198 14188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:55:36.029549 14188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Bootstrap complete.
I20260811 18:55:36.032320 14188 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:36.032569 14188 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f5c2738665e42538955580618b56e6c, State: Initialized, Role: FOLLOWER
I20260811 18:55:36.032778 14188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:36.032845 14188 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:36.032915 14188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:36.032981 14188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:55:36.034164 14188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:36.034263 14188 leader_election.cc:302] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f5c2738665e42538955580618b56e6c; no voters:
I20260811 18:55:36.034515 14188 leader_election.cc:288] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:55:36.034562 14192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:55:36.034690 14192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 2 LEADER]: Becoming Leader. State: Replica: 2f5c2738665e42538955580618b56e6c, State: Running, Role: LEADER
I20260811 18:55:36.034812 14192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:36.034849 14188 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:36.035167 14195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5c2738665e42538955580618b56e6c. Latest consensus state: current_term: 2 leader_uuid: "2f5c2738665e42538955580618b56e6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } } }
I20260811 18:55:36.035398 14195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:36.035336 14193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2f5c2738665e42538955580618b56e6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } } }
I20260811 18:55:36.035681 14193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:36.035794 14206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:36.036852 14206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:36.036964 14206 catalog_manager.cc:1259] Loaded cluster ID: b7e1819f1a884809b3d0302e6a4a9f12
I20260811 18:55:36.037005 14206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:55:36.037276 14206 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 18:55:36.043162 14206 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 18:55:36.046064 14206 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:36.046279 14206 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Loaded TSK: 0
I20260811 18:55:36.046531 14206 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:55:36.116436 14190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:36.116643 14190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:36.116667 14190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:36.117831 14190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:36.117877 14190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:36.117903 14190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:55:36.119503 14190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:43547
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=45289
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:36.119757 14190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:36.119997 14190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:36.125293 14235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.125301 14236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.125326 14238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.125782 14190 server_base.cc:1034] running on GCE node
I20260811 18:55:36.125985 14190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:36.126243 14190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:36.127415 14190 hybrid_clock.cc:648] HybridClock initialized: now 1786474536127404 us; error 31 us; skew 500 ppm
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:36.130225 14190 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:55:36.130735 14190 webserver.cc:460] Webserver started at http://127.23.226.193:45289/ using document root <none> and password file <none>
I20260811 18:55:36.131006 14190 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:36.131094 14190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:36.132606 14190 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.133490 14247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.133752 14190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.133865 14190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "f0ce440602fe478aa69b3b2fb31a29d1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "af25a4b1be85b9ae97c8a83aebfeae69"
server_key_iv: "fca651ba96bfbf45dc3c56a3f09241d6"
server_key_version: "encryptionkey@0"
I20260811 18:55:36.134245 14190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:36.141700 14190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:36.144240 14190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:36.144423 14190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:36.144675 14190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:36.145166 14258 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 18:55:36.147342 14190 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 18:55:36.147415 14190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 18:55:36.147461 14190 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 18:55:36.148135 14190 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 18:55:36.148195 14190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 18:55:36.148252 14258 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Bootstrap starting.
I20260811 18:55:36.155964 14190 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:43547
I20260811 18:55:36.156359 14190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:55:36.158360 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 14190
I20260811 18:55:36.158715 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:35751
--local_ip_for_outbound_sockets=127.23.226.194
--tserver_master_addrs=127.23.226.254:42519
--webserver_port=36471
--webserver_interface=127.23.226.194
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:36.161892 14258 log.cc:824] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:36.165598 14258 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:55:36.165968 14258 tablet_bootstrap.cc:492] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Bootstrap complete.
I20260811 18:55:36.166110 14419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:43547 every 8 connection(s)
I20260811 18:55:36.167544 14258 ts_tablet_manager.cc:1397] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.011s
I20260811 18:55:36.169378 14258 raft_consensus.cc:348] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:36.170008 14258 raft_consensus.cc:729] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ce440602fe478aa69b3b2fb31a29d1, State: Initialized, Role: FOLLOWER
I20260811 18:55:36.170219 14258 consensus_queue.cc:260] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } }
I20260811 18:55:36.170548 14258 ts_tablet_manager.cc:1428] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:36.179358 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.157129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:58117)
0811 18:55:36.162227 (+ 5098us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.162279 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.163016 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.167027 (+ 4011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:36.167031 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:36.167474 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:36.167866 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.167874 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.169708 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.169710 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.171359 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.171363 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.172299 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.172300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.172443 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.173143 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:36.173154 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:36.175034 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:36.177419 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:36.177427 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:36.177429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:36.177728 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:36.178037 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:36.178038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:36.178038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:36.178184 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:36.178690 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:36.178696 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:36.178853 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 18:55:36.178968 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 18:55:36.179146 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5049,"thread_start_us":110,"threads_started":1}
I20260811 18:55:36.179456 14425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.157229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:58117 (local address 127.23.226.254:42519)
0811 18:55:36.166437 (+ 9208us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.166447 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.166489 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:55:36.166634 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.166642 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.166703 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.166863 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:36.168023 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.169578 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.171487 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.172188 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.172325 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.175173 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:36.175178 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:36.175178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:36.175191 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:36.177321 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:36.177833 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:36.177837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:36.177837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:36.177961 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:36.178269 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:36.178270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:36.178270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:36.178610 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:36.178703 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.179071 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.179241 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9124,"thread_start_us":77,"threads_started":1}
I20260811 18:55:36.180653 14420 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42519
I20260811 18:55:36.180758 14420 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:36.180938 14420 heartbeater.cc:511] Master 127.23.226.254:42519 requested a full tablet report, sending...
I20260811 18:55:36.181802 14133 ts_manager.cc:194] Registered new tserver with Master: f0ce440602fe478aa69b3b2fb31a29d1 (127.23.226.193:43547)
I20260811 18:55:36.183209 14133 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:58117
I20260811 18:55:36.184296 14420 heartbeater.cc:503] Master 127.23.226.254:42519 was elected leader, sending a full tablet report...
I20260811 18:55:36.190862 14432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.182535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:43547 (local address 127.0.0.1:51008)
0811 18:55:36.186543 (+ 4008us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.186586 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.186666 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.186941 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:36.186944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:36.186947 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:36.187011 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.187013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.188294 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.188295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.189533 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.189536 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.190550 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.190551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.190638 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.190651 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 18:55:36.190728 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:55:36.190782 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3970,"thread_start_us":133,"threads_started":1}
I20260811 18:55:36.190883 14434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.182832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51008 (local address 127.23.226.193:43547)
0811 18:55:36.186574 (+ 3742us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.186580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.186659 (+ 79us) server_negotiation.cc:407] Connection header received
0811 18:55:36.186749 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.186752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.186771 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.186916 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:36.187113 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.188195 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.189628 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.190464 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.190548 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.190601 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.190756 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.190803 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3693,"thread_start_us":76,"threads_started":1}
I20260811 18:55:36.191632 14325 tablet_service.cc:1514] Processing DeleteTablet for tablet 6127210353e647359792dda2a25b72d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:35 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:51008
I20260811 18:55:36.192320 14435 tablet_replica.cc:330] stopping tablet replica
I20260811 18:55:36.192435 14435 raft_consensus.cc:2229] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:36.192507 14435 raft_consensus.cc:2258] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:36.192842 14435 ts_tablet_manager.cc:1905] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:36.195314 14435 ts_tablet_manager.cc:1918] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:36.195396 14435 log.cc:1196] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/6127210353e647359792dda2a25b72d6
I20260811 18:55:36.195633 14435 ts_tablet_manager.cc:1939] T 6127210353e647359792dda2a25b72d6 P f0ce440602fe478aa69b3b2fb31a29d1: Deleting consensus metadata
I20260811 18:55:36.196412 14108 catalog_manager.cc:4841] TS f0ce440602fe478aa69b3b2fb31a29d1 (127.23.226.193:43547): tablet 6127210353e647359792dda2a25b72d6 (table test-table [id=142df23abab54429a8e779f60ce19ada]) successfully deleted
W20260811 18:55:36.251719 14428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:36.251924 14428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:36.251947 14428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:36.253023 14428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:36.253059 14428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:36.253085 14428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:55:36.254484 14428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:35751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=36471
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:36.254690 14428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:36.254870 14428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:36.260243 14444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.260255 14447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.260258 14445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.260560 14428 server_base.cc:1034] running on GCE node
I20260811 18:55:36.260795 14428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:36.261065 14428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:36.262226 14428 hybrid_clock.cc:648] HybridClock initialized: now 1786474536262199 us; error 48 us; skew 500 ppm
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:36.265070 14428 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:55:36.265630 14428 webserver.cc:460] Webserver started at http://127.23.226.194:36471/ using document root <none> and password file <none>
I20260811 18:55:36.265878 14428 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:36.265965 14428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:36.267522 14428 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.268266 14458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.268496 14428 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.268651 14428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "c01599178e8c4aaab51e2beb1b197bb1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "261939a4b636ca28530fdc52c3c32f8e"
server_key_iv: "686ab2ae9f90a215c0e28e78e57b2ae0"
server_key_version: "encryptionkey@0"
I20260811 18:55:36.269019 14428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:36.278164 14428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:36.280598 14428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:36.280771 14428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:36.281026 14428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:36.281347 14428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:36.281402 14428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.281445 14428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:36.281471 14428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.288476 14428 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:35751
I20260811 18:55:36.288529 14633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:35751 every 8 connection(s)
I20260811 18:55:36.288897 14428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:36.294989 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 14428
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:36.295286 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:44501
--local_ip_for_outbound_sockets=127.23.226.195
--tserver_master_addrs=127.23.226.254:42519
--webserver_port=33565
--webserver_interface=127.23.226.195
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:36.299080 14425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.289670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:54243 (local address 127.23.226.254:42519)
0811 18:55:36.289748 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.289750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.289943 (+ 193us) server_negotiation.cc:407] Connection header received
0811 18:55:36.290515 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.290517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.290534 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.290599 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:36.291595 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.292104 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.293142 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.293362 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.293447 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.295785 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:36.295787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:36.295787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:36.295795 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:36.297522 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:36.297979 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:36.297980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:36.297981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:36.298058 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:36.298322 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:36.298323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:36.298323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:36.298515 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:36.298592 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.298937 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.299013 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:55:36.299363 14636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.289642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:54243)
0811 18:55:36.289797 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.289848 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.290382 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.290671 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:36.290675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:36.291284 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:36.291479 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.291483 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.292222 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.292223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.293041 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.293044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.293455 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.293456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.293597 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.294120 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:36.294128 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:36.295686 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:36.297612 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:36.297619 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:36.297621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:36.297893 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:36.298137 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:36.298138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:36.298138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:36.298249 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:36.298605 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:36.298613 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:36.298791 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 18:55:36.298909 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 18:55:36.299084 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260811 18:55:36.299938 14634 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42519
I20260811 18:55:36.300060 14634 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:36.300289 14634 heartbeater.cc:511] Master 127.23.226.254:42519 requested a full tablet report, sending...
I20260811 18:55:36.300769 14133 ts_manager.cc:194] Registered new tserver with Master: c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751)
I20260811 18:55:36.301142 14133 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:54243
W20260811 18:55:36.383774 14637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:36.383976 14637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:36.384001 14637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:36.385160 14637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:36.385210 14637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:36.385236 14637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:55:36.386796 14637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:44501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=33565
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:36.387048 14637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:36.387303 14637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:36.392566 14645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.392560 14644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.392560 14648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.392943 14637 server_base.cc:1034] running on GCE node
I20260811 18:55:36.393234 14637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:36.393491 14637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:36.394631 14637 hybrid_clock.cc:648] HybridClock initialized: now 1786474536394622 us; error 29 us; skew 500 ppm
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:36.397228 14637 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:55:36.397655 14637 webserver.cc:460] Webserver started at http://127.23.226.195:33565/ using document root <none> and password file <none>
I20260811 18:55:36.397909 14637 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:36.398005 14637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:36.399422 14637 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.400061 14658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.400249 14637 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.400352 14637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "890e7f75c1a747d694faf59c1afab0ef"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "825b80ed07aa1a73795a26ffe4460954"
server_key_iv: "6ccee263248bf6017afe1a041bd7a522"
server_key_version: "encryptionkey@0"
I20260811 18:55:36.400676 14637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:36.415807 14637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:36.418236 14637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:36.418391 14637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:36.418691 14637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:36.419081 14637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:36.419142 14637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.419189 14637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:36.419214 14637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.425338 14637 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:44501
I20260811 18:55:36.425436 14831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:44501 every 8 connection(s)
I20260811 18:55:36.425781 14637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:36.432511 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 14637
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:36.436719 14425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.426655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:39211 (local address 127.23.226.254:42519)
0811 18:55:36.426741 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.426743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.426976 (+ 233us) server_negotiation.cc:407] Connection header received
0811 18:55:36.427485 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.427487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.427498 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.427564 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:36.428566 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.429065 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.430138 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.430324 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.430382 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.433282 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:36.433283 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:36.433283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:36.433291 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:36.435133 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:36.435675 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:36.435676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:36.435676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:36.435731 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:36.436040 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:36.436041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:36.436041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:36.436179 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:36.436246 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.436586 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.436653 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:55:36.437393 14836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.426630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:39211)
0811 18:55:36.426818 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.426866 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.427395 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.427630 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:36.427634 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:36.428263 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:36.428469 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.428483 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.429185 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.429186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.430053 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.430056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.430759 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.430761 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.430897 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.431467 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:36.431477 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:36.433179 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:36.435227 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:36.435235 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:36.435238 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:36.435595 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:36.435812 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:36.435813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:36.435813 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:36.435967 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:36.436254 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:36.436260 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:36.436435 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 18:55:36.436558 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 18:55:36.437095 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":100,"threads_started":1}
I20260811 18:55:36.437994 14832 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42519
I20260811 18:55:36.438325 14832 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:36.438568 14832 heartbeater.cc:511] Master 127.23.226.254:42519 requested a full tablet report, sending...
I20260811 18:55:36.439073 14133 ts_manager.cc:194] Registered new tserver with Master: 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501)
I20260811 18:55:36.439465 14133 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:39211
I20260811 18:55:36.440694 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.432984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34622 (local address 127.23.226.254:42519)
0811 18:55:36.433122 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.433124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.433142 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:55:36.433281 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.433282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.433295 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.433376 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:36.434028 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.434852 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.436013 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.436387 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.436436 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.437843 (+ 1407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:36.437844 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:36.437845 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:36.437851 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:36.439448 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:36.439846 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:36.439847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:36.439848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:36.439912 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:36.440160 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:36.440162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:36.440162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:36.440274 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:36.440469 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.440505 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.440587 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":92,"threads_started":1}
I20260811 18:55:36.441509 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:55:36.444022 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.441844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34626 (local address 127.23.226.254:42519)
0811 18:55:36.441883 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.441884 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.441964 (+ 80us) server_negotiation.cc:407] Connection header received
0811 18:55:36.442024 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.442025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.442053 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.442121 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:55:36.442205 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.442725 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.443421 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.443602 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.443654 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.443784 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:55:36.443871 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:55:36.443930 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.443962 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.443979 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:55:36.444308 14133 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:55:36.445973 14133 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:55:36.448308 14325 tablet_service.cc:1467] Processing CreateTablet for tablet 491bd098f42e45b4905f8854f5e77035 (DEFAULT_TABLE table=test-table [id=0d150eb1879943889a440897319c16f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:36.448536 14325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491bd098f42e45b4905f8854f5e77035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:36.450225 14258 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Bootstrap starting.
I20260811 18:55:36.450611 14258 tablet_bootstrap.cc:654] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:36.451197 14258 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: No bootstrap required, opened a new log
I20260811 18:55:36.451277 14258 ts_tablet_manager.cc:1397] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.451400 14258 raft_consensus.cc:348] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.451473 14258 raft_consensus.cc:374] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:36.451519 14258 raft_consensus.cc:729] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ce440602fe478aa69b3b2fb31a29d1, State: Initialized, Role: FOLLOWER
I20260811 18:55:36.451560 14258 consensus_queue.cc:260] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.451635 14258 ts_tablet_manager.cc:1428] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.452800 14432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.447898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:35751 (local address 127.0.0.1:35548)
0811 18:55:36.447934 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.447945 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.447980 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.448483 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:36.448484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:36.448486 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:36.448523 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.448525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.449964 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.449965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.451033 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.451035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.452568 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.452568 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.452615 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.452618 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:55:36.452687 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 18:55:36.452730 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 18:55:36.452863 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.448027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35548 (local address 127.23.226.194:35751)
0811 18:55:36.448286 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.448291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.448303 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:55:36.448346 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.448348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.448364 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.448608 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:36.448721 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.449849 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.451749 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.452498 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.452556 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.452596 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.452724 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.452770 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":133,"threads_started":1}
I20260811 18:55:36.453545 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.447898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:44501 (local address 127.0.0.1:56420)
0811 18:55:36.448202 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.448213 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.448264 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.448616 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:36.448617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:36.448619 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:36.448664 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.448666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.449781 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.449782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.450953 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.450956 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.453286 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.453287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.453352 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.453355 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:55:36.453421 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 18:55:36.453459 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":153,"thread_start_us":123,"threads_started":1}
I20260811 18:55:36.453564 14846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.448218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56420 (local address 127.23.226.195:44501)
0811 18:55:36.448447 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.448452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.448461 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:55:36.448496 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.448498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.448513 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.448617 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:36.448740 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.449657 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.451044 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.453183 (+ 2139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.453262 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.453296 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.453430 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.453460 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":120,"threads_started":1}
I20260811 18:55:36.453655 14534 tablet_service.cc:1467] Processing CreateTablet for tablet 491bd098f42e45b4905f8854f5e77035 (DEFAULT_TABLE table=test-table [id=0d150eb1879943889a440897319c16f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:36.454051 14534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491bd098f42e45b4905f8854f5e77035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:36.454198 14730 tablet_service.cc:1467] Processing CreateTablet for tablet 491bd098f42e45b4905f8854f5e77035 (DEFAULT_TABLE table=test-table [id=0d150eb1879943889a440897319c16f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:36.454509 14730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491bd098f42e45b4905f8854f5e77035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:36.457051 14848 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: Bootstrap starting.
I20260811 18:55:36.457387 14850 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: Bootstrap starting.
I20260811 18:55:36.457849 14848 tablet_bootstrap.cc:654] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:36.458074 14850 tablet_bootstrap.cc:654] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:36.458525 14848 log.cc:824] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:36.458756 14850 log.cc:824] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:36.459453 14848 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: No bootstrap required, opened a new log
I20260811 18:55:36.459540 14850 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: No bootstrap required, opened a new log
I20260811 18:55:36.459535 14848 ts_tablet_manager.cc:1397] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:55:36.459604 14850 ts_tablet_manager.cc:1397] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:55:36.461580 14848 raft_consensus.cc:348] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.461580 14850 raft_consensus.cc:348] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.461758 14848 raft_consensus.cc:374] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:36.461758 14850 raft_consensus.cc:374] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:36.461798 14850 raft_consensus.cc:729] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890e7f75c1a747d694faf59c1afab0ef, State: Initialized, Role: FOLLOWER
I20260811 18:55:36.461798 14848 raft_consensus.cc:729] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c01599178e8c4aaab51e2beb1b197bb1, State: Initialized, Role: FOLLOWER
I20260811 18:55:36.461925 14848 consensus_queue.cc:260] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.461925 14850 consensus_queue.cc:260] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.462237 14850 ts_tablet_manager.cc:1428] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:36.462239 14848 ts_tablet_manager.cc:1428] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:36.462257 14634 heartbeater.cc:503] Master 127.23.226.254:42519 was elected leader, sending a full tablet report...
I20260811 18:55:36.462472 14832 heartbeater.cc:503] Master 127.23.226.254:42519 was elected leader, sending a full tablet report...
I20260811 18:55:36.496769 14431 raft_consensus.cc:482] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:36.496919 14431 raft_consensus.cc:504] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.497377 14431 leader_election.cc:288] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751), 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501)
I20260811 18:55:36.500780 14846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.497681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:50807 (local address 127.23.226.195:44501)
0811 18:55:36.497730 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.497733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.497743 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:55:36.497775 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.497776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.497788 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.497862 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:36.498032 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.498766 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.499881 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.500444 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.500499 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.500506 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.500683 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.500724 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:55:36.500802 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.497538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:44501 (local address 127.23.226.193:50807)
0811 18:55:36.497608 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.497620 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.497667 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.497880 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:36.497881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:36.497884 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:36.497949 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.497951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.498847 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.498848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.499788 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.499790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.500527 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.500528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.500603 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.500607 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:55:36.500668 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 18:55:36.500708 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 18:55:36.501159 14762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "491bd098f42e45b4905f8854f5e77035" candidate_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890e7f75c1a747d694faf59c1afab0ef" is_pre_election: true
I20260811 18:55:36.501353 14855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.497538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:35751 (local address 127.23.226.193:50865)
0811 18:55:36.497779 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.497791 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.497854 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.498004 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:36.498005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:36.498007 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:36.498487 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.498490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.499311 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.499313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.500255 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:36.500258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.501026 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.501027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:36.501158 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.501162 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:55:36.501214 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 18:55:36.501249 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":24,"thread_start_us":126,"threads_started":1}
I20260811 18:55:36.501364 14844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.497663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:50865 (local address 127.23.226.194:35751)
0811 18:55:36.497758 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.497760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.497852 (+ 92us) server_negotiation.cc:407] Connection header received
0811 18:55:36.497911 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.497912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.497921 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.497974 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:36.498573 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.499214 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.500344 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.500918 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.500989 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.500999 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.501253 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.501304 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 18:55:36.501369 14762 raft_consensus.cc:2454] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ce440602fe478aa69b3b2fb31a29d1 in term 0.
I20260811 18:55:36.501674 14563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "491bd098f42e45b4905f8854f5e77035" candidate_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c01599178e8c4aaab51e2beb1b197bb1" is_pre_election: true
I20260811 18:55:36.501703 14250 leader_election.cc:302] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 890e7f75c1a747d694faf59c1afab0ef, f0ce440602fe478aa69b3b2fb31a29d1; no voters:
I20260811 18:55:36.501824 14563 raft_consensus.cc:2454] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ce440602fe478aa69b3b2fb31a29d1 in term 0.
I20260811 18:55:36.501852 14431 raft_consensus.cc:2781] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:55:36.501912 14431 raft_consensus.cc:482] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:55:36.501943 14431 raft_consensus.cc:3037] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:36.502816 14431 raft_consensus.cc:504] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.502981 14431 leader_election.cc:288] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 1 election: Requested vote from peers c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751), 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501)
I20260811 18:55:36.503180 14762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "491bd098f42e45b4905f8854f5e77035" candidate_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890e7f75c1a747d694faf59c1afab0ef"
I20260811 18:55:36.503238 14563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "491bd098f42e45b4905f8854f5e77035" candidate_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c01599178e8c4aaab51e2beb1b197bb1"
I20260811 18:55:36.503296 14762 raft_consensus.cc:3037] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:36.503364 14563 raft_consensus.cc:3037] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:36.504186 14762 raft_consensus.cc:2454] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ce440602fe478aa69b3b2fb31a29d1 in term 1.
I20260811 18:55:36.504228 14563 raft_consensus.cc:2454] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ce440602fe478aa69b3b2fb31a29d1 in term 1.
I20260811 18:55:36.504356 14250 leader_election.cc:302] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 890e7f75c1a747d694faf59c1afab0ef, f0ce440602fe478aa69b3b2fb31a29d1; no voters:
I20260811 18:55:36.504446 14431 raft_consensus.cc:2781] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:36.504635 14431 raft_consensus.cc:686] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 LEADER]: Becoming Leader. State: Replica: f0ce440602fe478aa69b3b2fb31a29d1, State: Running, Role: LEADER
I20260811 18:55:36.504696 14431 consensus_queue.cc:237] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.505573 14128 catalog_manager.cc:5495] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0ce440602fe478aa69b3b2fb31a29d1 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } health_report { overall_health: HEALTHY } } }
I20260811 18:55:36.511602 14434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.509254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51012 (local address 127.23.226.193:43547)
0811 18:55:36.509331 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:36.509333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:36.509341 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:55:36.509375 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:36.509376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:36.509391 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:36.509463 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:55:36.509603 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.510065 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.510846 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:36.511034 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:36.511110 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:36.511282 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:55:36.511375 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:55:36.511450 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:36.511507 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 18:55:36.511526 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:55:36.513199 14563 raft_consensus.cc:1261] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 1 FOLLOWER]: Refusing update from remote peer f0ce440602fe478aa69b3b2fb31a29d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:36.513230 14762 raft_consensus.cc:1261] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 1 FOLLOWER]: Refusing update from remote peer f0ce440602fe478aa69b3b2fb31a29d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:36.513546 14431 consensus_queue.cc:1035] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:36.513684 14857 consensus_queue.cc:1035] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:36.516053 14861 mvcc.cc:205] Tried to move back new op lower bound from 7317399701555478528 to 7317399701523910656. Current Snapshot: MvccSnapshot[applied={T|T < 7317399701555478528}]
I20260811 18:55:36.516364 14863 mvcc.cc:205] Tried to move back new op lower bound from 7317399701555478528 to 7317399701523910656. Current Snapshot: MvccSnapshot[applied={T|T < 7317399701555478528}]
I20260811 18:55:36.516710 14864 mvcc.cc:205] Tried to move back new op lower bound from 7317399701555478528 to 7317399701523910656. Current Snapshot: MvccSnapshot[applied={T|T < 7317399701555478528}]
I20260811 18:55:36.518671 14128 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:36.518757 14128 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:36.519479 14128 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Sending DeleteTablet for 3 replicas of tablet 491bd098f42e45b4905f8854f5e77035
I20260811 18:55:36.519830 14730 tablet_service.cc:1514] Processing DeleteTablet for tablet 491bd098f42e45b4905f8854f5e77035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:36 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:56420
I20260811 18:55:36.519977 14534 tablet_service.cc:1514] Processing DeleteTablet for tablet 491bd098f42e45b4905f8854f5e77035 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:36 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:35548
I20260811 18:55:36.520082 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 14190
I20260811 18:55:36.520105 14875 tablet_replica.cc:330] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: stopping tablet replica
I20260811 18:55:36.520211 14875 raft_consensus.cc:2229] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:36.520318 14875 raft_consensus.cc:2258] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:36.524295 14876 tablet_replica.cc:330] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: stopping tablet replica
I20260811 18:55:36.524435 14876 raft_consensus.cc:2229] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:36.524583 14876 raft_consensus.cc:2258] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:36.525151 14876 ts_tablet_manager.cc:1905] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:36.527547 14876 ts_tablet_manager.cc:1918] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:36.527622 14876 log.cc:1196] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/491bd098f42e45b4905f8854f5e77035
I20260811 18:55:36.527870 14876 ts_tablet_manager.cc:1939] T 491bd098f42e45b4905f8854f5e77035 P c01599178e8c4aaab51e2beb1b197bb1: Deleting consensus metadata
I20260811 18:55:36.528251 14108 catalog_manager.cc:4841] TS c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751): tablet 491bd098f42e45b4905f8854f5e77035 (table test-table [id=0d150eb1879943889a440897319c16f8]) successfully deleted
I20260811 18:55:36.528838 14875 ts_tablet_manager.cc:1905] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:36.530704 14875 ts_tablet_manager.cc:1918] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:36.530798 14875 log.cc:1196] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/491bd098f42e45b4905f8854f5e77035
I20260811 18:55:36.531059 14875 ts_tablet_manager.cc:1939] T 491bd098f42e45b4905f8854f5e77035 P 890e7f75c1a747d694faf59c1afab0ef: Deleting consensus metadata
I20260811 18:55:36.531500 14107 catalog_manager.cc:4841] TS 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501): tablet 491bd098f42e45b4905f8854f5e77035 (table test-table [id=0d150eb1879943889a440897319c16f8]) successfully deleted
W20260811 18:55:36.537957 14108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:43547 (error 108)
I20260811 18:55:36.538290 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 14428
I20260811 18:55:36.541051 14843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.538472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:43547 (local address 127.0.0.1:51022)
0811 18:55:36.540961 (+ 2489us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.541009 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:43547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2465}
W20260811 18:55:36.542809 14108 catalog_manager.cc:4584] TS f0ce440602fe478aa69b3b2fb31a29d1 (127.23.226.193:43547): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 491bd098f42e45b4905f8854f5e77035: Network error: Client connection negotiation failed: client connection to 127.23.226.193:43547: connect: Connection refused (error 111)
I20260811 18:55:36.553176 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 14637
I20260811 18:55:36.562227 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 14081
I20260811 18:55:36.573148 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42519
--webserver_interface=127.23.226.254
--webserver_port=38905
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:42519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:36.657639 14879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:36.657881 14879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:36.657918 14879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:36.659072 14879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:36.659142 14879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:36.659166 14879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:36.659188 14879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:36.659222 14879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:36.660712 14879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:42519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=38905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:36.660998 14879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:36.661242 14879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:36.666292 14889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.666404 14879 server_base.cc:1034] running on GCE node
W20260811 18:55:36.666292 14894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.666287 14886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.666837 14879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:36.667220 14879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:36.668398 14879 hybrid_clock.cc:648] HybridClock initialized: now 1786474536668379 us; error 36 us; skew 500 ppm
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:36.671339 14879 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:55:36.671790 14879 webserver.cc:460] Webserver started at http://127.23.226.254:38905/ using document root <none> and password file <none>
I20260811 18:55:36.672041 14879 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:36.672114 14879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:36.673468 14879 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:36.674182 14906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.674449 14879 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:36.674567 14879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "2f5c2738665e42538955580618b56e6c"
format_stamp: "Formatted at 2026-08-11 18:55:34 on dist-test-slave-68xk"
server_key: "379b06db2446be7cec425ca9fcdffa38"
server_key_iv: "32de08a32a876756e192a620ec025ce1"
server_key_version: "encryptionkey@0"
I20260811 18:55:36.674948 14879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:36.687124 14879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:36.689560 14879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:36.689733 14879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:36.693853 14879 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:42519
I20260811 18:55:36.693892 14992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:42519 every 8 connection(s)
I20260811 18:55:36.694276 14879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:36.695953 14994 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:55:36.696656 14994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Bootstrap starting.
I20260811 18:55:36.698774 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 14879
I20260811 18:55:36.699074 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:43547
--local_ip_for_outbound_sockets=127.23.226.193
--tserver_master_addrs=127.23.226.254:42519
--webserver_port=45289
--webserver_interface=127.23.226.193
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:36.706648 14994 log.cc:824] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:36.708942 14994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:55:36.709264 14994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c: Bootstrap complete.
I20260811 18:55:36.711668 14994 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:36.711900 14994 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f5c2738665e42538955580618b56e6c, State: Initialized, Role: FOLLOWER
I20260811 18:55:36.712076 14994 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:36.712137 14994 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:36.712201 14994 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:36.712266 14994 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:55:36.713263 14994 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:36.713376 14994 leader_election.cc:302] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f5c2738665e42538955580618b56e6c; no voters:
I20260811 18:55:36.713584 14994 leader_election.cc:288] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 18:55:36.713620 14999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260811 18:55:36.713760 14999 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [term 3 LEADER]: Becoming Leader. State: Replica: 2f5c2738665e42538955580618b56e6c, State: Running, Role: LEADER
I20260811 18:55:36.713862 14994 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:36.713856 14999 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } }
I20260811 18:55:36.714190 15003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2f5c2738665e42538955580618b56e6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } } }
I20260811 18:55:36.714336 15003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:36.714650 15001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5c2738665e42538955580618b56e6c. Latest consensus state: current_term: 3 leader_uuid: "2f5c2738665e42538955580618b56e6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5c2738665e42538955580618b56e6c" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42519 } } }
I20260811 18:55:36.714802 15001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5c2738665e42538955580618b56e6c [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:36.714639 15011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:36.715624 15011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:55:36.715811 15011 catalog_manager.cc:1259] Loaded cluster ID: b7e1819f1a884809b3d0302e6a4a9f12
I20260811 18:55:36.716012 15011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 18:55:36.716382 15011 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f452be489ad google::LogMessage::Fail() at ??:0
@ 0x7f452be4b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f452be484de google::LogMessage::Flush() at ??:0
@ 0x7f452be49a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4533d690f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f4533d728b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f452dd160d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f452dd0b954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f452eb6f6db start_thread at ??:0
@ 0x7f452a94661f clone at ??:0
W20260811 18:55:36.798545 14996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:36.798758 14996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:36.798785 14996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:36.799973 14996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:36.800015 14996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:36.800042 14996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:55:36.801535 14996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:43547
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=45289
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:36.801791 14996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:36.802052 14996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:36.807691 15057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.807899 14996 server_base.cc:1034] running on GCE node
W20260811 18:55:36.807686 15055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.807686 15054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.808220 14996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:36.808531 14996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:36.809732 14996 hybrid_clock.cc:648] HybridClock initialized: now 1786474536809708 us; error 41 us; skew 500 ppm
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:36.812999 14996 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:55:36.813547 14996 webserver.cc:460] Webserver started at http://127.23.226.193:45289/ using document root <none> and password file <none>
I20260811 18:55:36.813835 14996 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:36.813920 14996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:36.815670 14996 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.816538 15068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.816817 14996 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:36.816939 14996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "f0ce440602fe478aa69b3b2fb31a29d1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "af25a4b1be85b9ae97c8a83aebfeae69"
server_key_iv: "fca651ba96bfbf45dc3c56a3f09241d6"
server_key_version: "encryptionkey@0"
I20260811 18:55:36.817346 14996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:36.831828 14996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:36.834343 14996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:36.834595 14996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:36.834873 14996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:36.835392 15080 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 18:55:36.837571 14996 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 18:55:36.837656 14996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 18:55:36.837710 14996 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 18:55:36.838560 14996 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 18:55:36.838624 14996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:36.838677 15080 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Bootstrap starting.
I20260811 18:55:36.847215 14996 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:43547
I20260811 18:55:36.847365 15254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:43547 every 8 connection(s)
I20260811 18:55:36.847725 14996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:55:36.851536 15080 log.cc:824] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:36.854681 15080 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:55:36.855082 15080 tablet_bootstrap.cc:492] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Bootstrap complete.
I20260811 18:55:36.855959 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 14996
I20260811 18:55:36.856284 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:35751
--local_ip_for_outbound_sockets=127.23.226.194
--tserver_master_addrs=127.23.226.254:42519
--webserver_port=36471
--webserver_interface=127.23.226.194
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:36.856707 15080 ts_tablet_manager.cc:1397] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.013s
I20260811 18:55:36.858513 15080 raft_consensus.cc:348] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.858855 15080 raft_consensus.cc:729] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ce440602fe478aa69b3b2fb31a29d1, State: Initialized, Role: FOLLOWER
I20260811 18:55:36.859030 15080 consensus_queue.cc:260] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:36.859331 15080 ts_tablet_manager.cc:1428] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
W20260811 18:55:36.921605 15261 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:55:36.848537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:42979)
0811 18:55:36.848742 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.848793 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:36.849316 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:36.921368 (+ 72052us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":117,"threads_started":1}
W20260811 18:55:36.922024 15257 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:42519 (0 consecutive failures): Network error: Failed to ping master at 127.23.226.254:42519: Client connection negotiation failed: client connection to 127.23.226.254:42519: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 18:55:36.922457 15261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.922300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:34135)
0811 18:55:36.922363 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.922428 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 18:55:36.922844 15261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.922777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:52631)
0811 18:55:36.922806 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.922829 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 18:55:36.922963 15257 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:55:36.944305 15264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:36.944535 15264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:36.944581 15264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:36.945760 15264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:36.945832 15264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:36.945878 15264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:55:36.947430 15264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:35751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=36471
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:36.947712 15264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:36.947952 15264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:36.953241 15272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:36.953222 15274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.953543 15264 server_base.cc:1034] running on GCE node
W20260811 18:55:36.953241 15278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:36.953806 15264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:36.954080 15264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:36.955286 15264 hybrid_clock.cc:648] HybridClock initialized: now 1786474536955271 us; error 27 us; skew 500 ppm
Aug 11 18:55:36 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:36.958362 15264 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:55:36.958873 15264 webserver.cc:460] Webserver started at http://127.23.226.194:36471/ using document root <none> and password file <none>
I20260811 18:55:36.959107 15264 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:36.959180 15264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:36.960574 15264 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:36.961261 15290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.961457 15264 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:36.961560 15264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "c01599178e8c4aaab51e2beb1b197bb1"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "261939a4b636ca28530fdc52c3c32f8e"
server_key_iv: "686ab2ae9f90a215c0e28e78e57b2ae0"
server_key_version: "encryptionkey@0"
I20260811 18:55:36.961915 15264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:36.972533 15264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:36.974828 15264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:36.974995 15264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:36.975225 15264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:36.975529 15264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:36.975584 15264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.975623 15264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:36.975651 15264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:36.981596 15264 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:35751
I20260811 18:55:36.981652 15473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:35751 every 8 connection(s)
I20260811 18:55:36.981983 15264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:36.982673 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 15264
I20260811 18:55:36.982932 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:44501
--local_ip_for_outbound_sockets=127.23.226.195
--tserver_master_addrs=127.23.226.254:42519
--webserver_port=33565
--webserver_interface=127.23.226.195
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:55:36.986483 15481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.982674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:54515)
0811 18:55:36.986164 (+ 3490us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.986267 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3438,"thread_start_us":2015,"threads_started":1}
W20260811 18:55:36.986984 15476 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:42519 (0 consecutive failures): Network error: Failed to ping master at 127.23.226.254:42519: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
I20260811 18:55:36.987370 15481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.987247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:42883)
0811 18:55:36.987303 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.987337 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 18:55:36.987793 15481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:36.987668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:37733)
0811 18:55:36.987725 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:36.987763 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 18:55:36.987918 15476 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:55:37.071393 15482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:37.071605 15482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:37.071630 15482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:37.072719 15482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:37.072754 15482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:37.072781 15482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:55:37.074152 15482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:44501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=33565
--tserver_master_addrs=127.23.226.254:42519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:37.074328 15482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:37.074595 15482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:37.079550 15498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:37.079574 15493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:37.079572 15494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:37.079952 15482 server_base.cc:1034] running on GCE node
I20260811 18:55:37.080215 15482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:37.080468 15482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:37.081635 15482 hybrid_clock.cc:648] HybridClock initialized: now 1786474537081625 us; error 36 us; skew 500 ppm
Aug 11 18:55:37 dist-test-slave-68xk krb5kdc[13211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474537, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:37.084224 15482 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:55:37.084599 15482 webserver.cc:460] Webserver started at http://127.23.226.195:33565/ using document root <none> and password file <none>
I20260811 18:55:37.084777 15482 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:37.084818 15482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:37.086133 15482 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:37.086781 15510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:37.086959 15482 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:37.087097 15482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "890e7f75c1a747d694faf59c1afab0ef"
format_stamp: "Formatted at 2026-08-11 18:55:35 on dist-test-slave-68xk"
server_key: "825b80ed07aa1a73795a26ffe4460954"
server_key_iv: "6ccee263248bf6017afe1a041bd7a522"
server_key_version: "encryptionkey@0"
I20260811 18:55:37.087440 15482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:37.106827 15482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:37.109037 15482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:37.109222 15482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:37.109477 15482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:37.109835 15482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:37.109899 15482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:37.109946 15482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:37.109977 15482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:37.117257 15482 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:44501
I20260811 18:55:37.117311 15687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:44501 every 8 connection(s)
I20260811 18:55:37.117684 15482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:37.118755 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:37.118301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:47413)
0811 18:55:37.118504 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:37.118613 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
W20260811 18:55:37.119160 15688 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:42519 (0 consecutive failures): Network error: Failed to ping master at 127.23.226.254:42519: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
I20260811 18:55:37.119452 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:37.119353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:38221)
0811 18:55:37.119403 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:37.119434 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 18:55:37.119750 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:37.119656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:47985)
0811 18:55:37.119700 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:37.119724 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 18:55:37.119867 15688 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:55:37.119988 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 15482
I20260811 18:55:37.923533 15694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:37.923299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:33827)
0811 18:55:37.923429 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:37.923464 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260811 18:55:37.988445 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:37.988236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:53903)
0811 18:55:37.988355 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:37.988388 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260811 18:55:38.120537 15696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:38.120283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:50567)
0811 18:55:38.120406 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:38.120445 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260811 18:55:38.418651 15699 raft_consensus.cc:482] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:38.418848 15699 raft_consensus.cc:504] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:38.419230 15699 leader_election.cc:288] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751), 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501)
Aug 11 18:55:38 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.194@KRBTEST.COM
Aug 11 18:55:38 dist-test-slave-68xk krb5kdc[13211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474536, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.195@KRBTEST.COM
I20260811 18:55:38.430739 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:38.419545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:34901 (local address 127.23.226.195:44501)
0811 18:55:38.419748 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:38.419759 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:38.419902 (+ 143us) server_negotiation.cc:407] Connection header received
0811 18:55:38.420569 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:38.420572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:38.420620 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:38.420759 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:38.421326 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:38.422303 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:38.423352 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:38.423761 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:38.423880 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:38.427009 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:38.427019 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:38.427020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:38.427032 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:38.428747 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:38.429179 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:38.429182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:38.429183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:38.429447 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:38.429673 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:38.429674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:38.429674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:38.429969 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:38.430031 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:38.430476 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 18:55:38.430620 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":66,"threads_started":1}
I20260811 18:55:38.430783 15694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:38.419395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:35751 (local address 127.23.226.193:58719)
0811 18:55:38.419463 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:38.419476 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:38.419550 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:38.420550 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:38.420554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:38.421015 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:38.421202 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:38.421208 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:38.422502 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:38.422503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:38.423257 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:38.423259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:38.423868 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:38.423869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:38.423972 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:38.424657 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:38.424662 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:38.426310 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:38.428619 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:38.428627 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:38.428629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:38.428853 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:38.429191 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:38.429192 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:38.429192 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:38.429351 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:38.429914 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:38.429921 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:38.430234 (+ 313us) client_negotiation.cc:769] Sending connection context
0811 18:55:38.430375 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 18:55:38.430648 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":60}
I20260811 18:55:38.430739 15703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:38.419547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:58719 (local address 127.23.226.194:35751)
0811 18:55:38.419704 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:38.419718 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:38.419754 (+ 36us) server_negotiation.cc:407] Connection header received
0811 18:55:38.420278 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:38.420281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:38.420361 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:38.420485 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:38.421331 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:38.422368 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:38.423359 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:38.423762 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:38.423878 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:38.426459 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:38.426465 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:38.426465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:38.426479 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:38.428501 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:38.428943 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:38.428947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:38.428947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:38.429094 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:38.429445 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:38.429446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:38.429446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:38.429789 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:38.429878 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:38.430476 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 18:55:38.430621 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260811 18:55:38.431113 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:38.419395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:44501 (local address 127.23.226.193:34901)
0811 18:55:38.419817 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:38.419834 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:38.419906 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:38.420737 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:38.420738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:38.421030 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:38.421202 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:38.421208 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:38.422403 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:38.422404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:38.423256 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:38.423258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:38.423859 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:38.423860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:38.423978 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:38.424637 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:38.424646 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:38.426884 (+ 2238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:38.428852 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:38.428853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:38.428854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:38.429064 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:38.429527 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:38.429528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:38.429528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:38.429599 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:38.430146 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:38.430147 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:38.430234 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 18:55:38.430375 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 18:55:38.430713 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":469,"thread_start_us":86,"threads_started":1}
W20260811 18:55:38.431880 15074 leader_election.cc:341] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751): Not found: Tablet not found: 491bd098f42e45b4905f8854f5e77035
W20260811 18:55:38.431967 15071 leader_election.cc:341] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501): Not found: Tablet not found: 491bd098f42e45b4905f8854f5e77035
I20260811 18:55:38.432056 15071 leader_election.cc:302] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ce440602fe478aa69b3b2fb31a29d1; no voters: 890e7f75c1a747d694faf59c1afab0ef, c01599178e8c4aaab51e2beb1b197bb1
I20260811 18:55:38.432178 15699 raft_consensus.cc:2726] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:55:38.924307 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:38.924127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:42227)
0811 18:55:38.924216 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:38.924264 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 18:55:38.989194 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:38.988963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:51555)
0811 18:55:38.989100 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:38.989141 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
I20260811 18:55:39.121526 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:39.121279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:43287)
0811 18:55:39.121438 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:39.121481 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":65,"threads_started":1}
I20260811 18:55:39.925166 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:39.924916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:57107)
0811 18:55:39.925069 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:39.925117 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260811 18:55:39.989986 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:39.989734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:36275)
0811 18:55:39.989889 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:39.989937 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":68,"threads_started":1}
I20260811 18:55:40.082046 15712 raft_consensus.cc:482] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:40.082293 15712 raft_consensus.cc:504] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:40.082544 15712 leader_election.cc:288] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751), 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501)
W20260811 18:55:40.083057 15071 leader_election.cc:341] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501): Not found: Tablet not found: 491bd098f42e45b4905f8854f5e77035
W20260811 18:55:40.083146 15074 leader_election.cc:341] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751): Not found: Tablet not found: 491bd098f42e45b4905f8854f5e77035
I20260811 18:55:40.083212 15074 leader_election.cc:302] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ce440602fe478aa69b3b2fb31a29d1; no voters: 890e7f75c1a747d694faf59c1afab0ef, c01599178e8c4aaab51e2beb1b197bb1
I20260811 18:55:40.083320 15712 raft_consensus.cc:2726] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:55:40.122294 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:40.122039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:51411)
0811 18:55:40.122201 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:40.122250 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260811 18:55:40.925985 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:40.925738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:41013)
0811 18:55:40.925897 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:40.925937 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":72,"threads_started":1}
I20260811 18:55:40.991946 15716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:40.990564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:42615)
0811 18:55:40.991865 (+ 1301us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:40.991900 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1275,"thread_start_us":1244,"threads_started":1}
I20260811 18:55:41.123023 15717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:41.122784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:52005)
0811 18:55:41.122934 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:41.122977 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260811 18:55:41.926882 15718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:41.926665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:35419)
0811 18:55:41.926793 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:41.926832 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":62,"threads_started":1}
I20260811 18:55:41.992699 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:41.992437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:41675)
0811 18:55:41.992605 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:41.992651 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
I20260811 18:55:42.123699 15721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:42.123489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:40893)
0811 18:55:42.123618 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:42.123655 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260811 18:55:42.347604 15722 raft_consensus.cc:482] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:42.347709 15722 raft_consensus.cc:504] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:42.347937 15722 leader_election.cc:288] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751), 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501)
W20260811 18:55:42.348352 15074 leader_election.cc:341] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751): Not found: Tablet not found: 491bd098f42e45b4905f8854f5e77035
W20260811 18:55:42.348448 15071 leader_election.cc:341] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501): Not found: Tablet not found: 491bd098f42e45b4905f8854f5e77035
I20260811 18:55:42.348528 15071 leader_election.cc:302] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ce440602fe478aa69b3b2fb31a29d1; no voters: 890e7f75c1a747d694faf59c1afab0ef, c01599178e8c4aaab51e2beb1b197bb1
I20260811 18:55:42.348618 15722 raft_consensus.cc:2726] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:55:42.930720 15723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:42.930431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:54035)
0811 18:55:42.930575 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:42.930631 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260811 18:55:42.995450 15725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:42.993333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:60811)
0811 18:55:42.995359 (+ 2026us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:42.995400 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2007,"thread_start_us":1947,"threads_started":1}
I20260811 18:55:43.124398 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:43.124188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:43063)
0811 18:55:43.124322 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:43.124358 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260811 18:55:43.931584 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:43.931331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:35395)
0811 18:55:43.931486 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:43.931531 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260811 18:55:43.996178 15731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:43.995961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:45873)
0811 18:55:43.996092 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:43.996131 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260811 18:55:44.125240 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:44.124939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:48697)
0811 18:55:44.125144 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:44.125190 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":69,"threads_started":1}
I20260811 18:55:44.932495 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:44.932261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:56725)
0811 18:55:44.932402 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:44.932445 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":73,"threads_started":1}
I20260811 18:55:44.999007 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:44.996842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:51955)
0811 18:55:44.998928 (+ 2086us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:44.998961 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2070,"thread_start_us":2020,"threads_started":1}
I20260811 18:55:45.125970 15735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:45.125759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:50007)
0811 18:55:45.125891 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:45.125927 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260811 18:55:45.933418 15739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:45.933162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:40143)
0811 18:55:45.933327 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:45.933370 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
I20260811 18:55:45.999706 15740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:45.999473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:38135)
0811 18:55:45.999623 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:45.999660 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
I20260811 18:55:46.126802 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:46.126525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:57857)
0811 18:55:46.126703 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:46.126754 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":81,"threads_started":1}
I20260811 18:55:46.934288 15742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:46.934023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:34491)
0811 18:55:46.934186 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:46.934238 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":68,"threads_started":1}
I20260811 18:55:46.984185 15743 raft_consensus.cc:482] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:46.984298 15743 raft_consensus.cc:504] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c01599178e8c4aaab51e2beb1b197bb1" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 35751 } } peers { permanent_uuid: "890e7f75c1a747d694faf59c1afab0ef" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 44501 } } peers { permanent_uuid: "f0ce440602fe478aa69b3b2fb31a29d1" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 43547 } }
I20260811 18:55:46.984583 15743 leader_election.cc:288] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751), 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501)
W20260811 18:55:46.984997 15074 leader_election.cc:341] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c01599178e8c4aaab51e2beb1b197bb1 (127.23.226.194:35751): Not found: Tablet not found: 491bd098f42e45b4905f8854f5e77035
W20260811 18:55:46.985106 15071 leader_election.cc:341] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 890e7f75c1a747d694faf59c1afab0ef (127.23.226.195:44501): Not found: Tablet not found: 491bd098f42e45b4905f8854f5e77035
I20260811 18:55:46.985184 15071 leader_election.cc:302] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ce440602fe478aa69b3b2fb31a29d1; no voters: 890e7f75c1a747d694faf59c1afab0ef, c01599178e8c4aaab51e2beb1b197bb1
I20260811 18:55:46.985287 15743 raft_consensus.cc:2726] T 491bd098f42e45b4905f8854f5e77035 P f0ce440602fe478aa69b3b2fb31a29d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:55:47.000617 15745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:47.000346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:47279)
0811 18:55:47.000504 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:47.000548 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260811 18:55:47.127636 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:47.127349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:42421)
0811 18:55:47.127520 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:47.127568 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":67,"threads_started":1}
I20260811 18:55:47.935020 15747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:47.934794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:45831)
0811 18:55:47.934928 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:47.934969 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":70,"threads_started":1}
I20260811 18:55:48.001324 15749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:48.001073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:43795)
0811 18:55:48.001231 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:48.001277 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":68,"threads_started":1}
I20260811 18:55:48.128463 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:48.128207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:54077)
0811 18:55:48.128370 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:48.128414 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260811 18:55:48.935829 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:48.935559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:54923)
0811 18:55:48.935716 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:48.935768 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":83,"threads_started":1}
I20260811 18:55:49.002060 15753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:49.001850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:59857)
0811 18:55:49.001973 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:49.002011 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260811 18:55:49.129290 15754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:49.129032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:52137)
0811 18:55:49.129192 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:49.129239 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260811 18:55:49.936774 15756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:49.936498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:56735)
0811 18:55:49.936673 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:49.936722 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":74,"threads_started":1}
I20260811 18:55:50.002925 15757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:50.002700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:44975)
0811 18:55:50.002836 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:50.002874 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260811 18:55:50.130143 15759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:50.129761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:52357)
0811 18:55:50.130038 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:50.130084 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":83,"threads_started":1}
I20260811 18:55:50.937541 15760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:50.937325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:44419)
0811 18:55:50.937464 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:50.937494 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260811 18:55:51.003803 15763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:51.003457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:34817)
0811 18:55:51.003688 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:51.003745 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":127,"threads_started":1}
I20260811 18:55:51.130934 15764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:51.130697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:50007)
0811 18:55:51.130845 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:51.130885 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":70,"threads_started":1}
I20260811 18:55:51.938395 15767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:51.938168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.193:37553)
0811 18:55:51.938307 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:51.938346 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260811 18:55:52.004683 15768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:52.004370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.194:47355)
0811 18:55:52.004576 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:52.004625 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":89,"threads_started":1}
I20260811 18:55:52.124296 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 14996
I20260811 18:55:52.131675 15769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:52.131480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42519 (local address 127.23.226.195:43845)
0811 18:55:52.131594 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:52.131633 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:42519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":69,"threads_started":1}
I20260811 18:55:52.135504 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 15264
I20260811 18:55:52.147094 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 15482
2026-08-11T18:55:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18653 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:55:52 dist-test-slave-68xk krb5kdc[15774](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:55:52 dist-test-slave-68xk krb5kdc[15774](info): set up 2 sockets
Aug 11 18:55:52 dist-test-slave-68xk krb5kdc[15774](info): commencing operation
krb5kdc: starting...
W20260811 18:55:53.434659 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:55:53 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:55:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:55:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:55:53.566354 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46595
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:46595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:53.650028 15794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:53.650274 15794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:53.650313 15794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:53.651494 15794 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:55:53.651557 15794 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:55:53.651578 15794 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:55:53.651597 15794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:55:53.651626 15794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:53.651669 15794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:53.651696 15794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:55:53.651714 15794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:55:53.653465 15794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:46595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:53.653790 15794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:53.654037 15794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:53.658949 15803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:53.658939 15802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:53.658941 15806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:53.659343 15794 server_base.cc:1034] running on GCE node
I20260811 18:55:53.659581 15794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:53.659839 15794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:53.660984 15794 hybrid_clock.cc:648] HybridClock initialized: now 1786474553660973 us; error 33 us; skew 500 ppm
Aug 11 18:55:53 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474553, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:53.663595 15794 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:55:53.664072 15794 webserver.cc:460] Webserver started at http://127.23.226.254:37589/ using document root <none> and password file <none>
I20260811 18:55:53.664310 15794 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:53.664357 15794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:53.664500 15794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:53.665594 15794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "6c13883e957341599e3da58be323192a"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "d0306a4aa20005dd997021dbbfcf53cc"
server_key_iv: "daad93d1f9a9dc030c74bcd5e056af91"
server_key_version: "encryptionkey@0"
I20260811 18:55:53.665979 15794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "6c13883e957341599e3da58be323192a"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "d0306a4aa20005dd997021dbbfcf53cc"
server_key_iv: "daad93d1f9a9dc030c74bcd5e056af91"
server_key_version: "encryptionkey@0"
I20260811 18:55:53.667472 15794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:55:53.668357 15814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:53.668537 15794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:53.668653 15794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "6c13883e957341599e3da58be323192a"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "d0306a4aa20005dd997021dbbfcf53cc"
server_key_iv: "daad93d1f9a9dc030c74bcd5e056af91"
server_key_version: "encryptionkey@0"
I20260811 18:55:53.668731 15794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:53.680172 15794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:53.682137 15794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:53.682312 15794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:53.686868 15794 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:46595
I20260811 18:55:53.686904 15901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:46595 every 8 connection(s)
I20260811 18:55:53.687299 15794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:55:53.688156 15902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:53.690550 15902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Bootstrap starting.
I20260811 18:55:53.691184 15902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:53.691497 15902 log.cc:824] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:53.691758 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 15794
I20260811 18:55:53.691874 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:55:53.692059 24459 external_mini_cluster.cc:1428] Setting key fa1a4060882a2ff7b35a0bf195e579e6
I20260811 18:55:53.692272 15902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: No bootstrap required, opened a new log
I20260811 18:55:53.695250 15902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:55:53.695386 15902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:53.695408 15902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c13883e957341599e3da58be323192a, State: Initialized, Role: FOLLOWER
I20260811 18:55:53.695538 15902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:55:53.695614 15902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:55:53.695654 15902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:55:53.695704 15902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:53.696435 15902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:55:53.696547 15902 leader_election.cc:302] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c13883e957341599e3da58be323192a; no voters:
I20260811 18:55:53.696709 15902 leader_election.cc:288] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:55:53.696789 15909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:53.696946 15909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 1 LEADER]: Becoming Leader. State: Replica: 6c13883e957341599e3da58be323192a, State: Running, Role: LEADER
I20260811 18:55:53.697072 15902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:55:53.697101 15909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:55:53.697553 15909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c13883e957341599e3da58be323192a. Latest consensus state: current_term: 1 leader_uuid: "6c13883e957341599e3da58be323192a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } } }
I20260811 18:55:53.697563 15911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c13883e957341599e3da58be323192a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } } }
I20260811 18:55:53.697757 15911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:53.698004 15909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: This master's current role is: LEADER
I20260811 18:55:53.698359 15923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:55:53.698935 15923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 18:55:53 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:53.701036 15923 catalog_manager.cc:1347] Generated new cluster ID: a308b14cfdcd4c80a04221b76a35c9ad
I20260811 18:55:53.701098 15923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:55:53.705650 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:53.692633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43544 (local address 127.23.226.254:46595)
0811 18:55:53.692834 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:53.692841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:53.692867 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:55:53.693620 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:53.693628 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:53.693678 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:53.693795 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:53.694656 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:53.695705 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:53.696800 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:53.697440 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:53.698573 (+ 1133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:53.700575 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:53.700578 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:53.700579 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:53.700589 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:53.703951 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:53.704379 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:53.704382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:53.704382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:53.704501 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:53.704760 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:53.704761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:53.704761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:53.705055 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:53.705185 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:53.705330 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 18:55:53.705455 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":112,"threads_started":1}
I20260811 18:55:53.723023 15923 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:55:53.723591 15923 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:55:53.725581 15923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Generated new TSK 0
I20260811 18:55:53.725764 15923 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:55:53.761917 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:46595
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:53.853605 15945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:53.853838 15945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:53.853865 15945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:53.855099 15945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:53.855154 15945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:53.855182 15945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:55:53.856782 15945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:53.857049 15945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:53.857309 15945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:53.862603 15951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:53.862584 15954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:53.862584 15952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:53.862923 15945 server_base.cc:1034] running on GCE node
I20260811 18:55:53.863165 15945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:53.863427 15945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:53.864619 15945 hybrid_clock.cc:648] HybridClock initialized: now 1786474553864602 us; error 34 us; skew 500 ppm
Aug 11 18:55:53 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474553, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:53.867893 15945 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:55:53.868503 15945 webserver.cc:460] Webserver started at http://127.23.226.193:37457/ using document root <none> and password file <none>
I20260811 18:55:53.868759 15945 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:53.868834 15945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:53.868997 15945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:53.870199 15945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "4dc5a1f9290f401c821b4dec9352d3fb"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "15608b350263a222608b9b791ad87c17"
server_key_iv: "b2ac74500fc763f5153ebe45a7e1b22f"
server_key_version: "encryptionkey@0"
I20260811 18:55:53.870651 15945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "4dc5a1f9290f401c821b4dec9352d3fb"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "15608b350263a222608b9b791ad87c17"
server_key_iv: "b2ac74500fc763f5153ebe45a7e1b22f"
server_key_version: "encryptionkey@0"
I20260811 18:55:53.872213 15945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:53.873129 15965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:53.873313 15945 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:55:53.873430 15945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "4dc5a1f9290f401c821b4dec9352d3fb"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "15608b350263a222608b9b791ad87c17"
server_key_iv: "b2ac74500fc763f5153ebe45a7e1b22f"
server_key_version: "encryptionkey@0"
I20260811 18:55:53.873520 15945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:53.891916 15945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:53.894011 15945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:53.894201 15945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:53.894527 15945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:53.894906 15945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:53.894966 15945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:53.895015 15945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:53.895047 15945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:53.902086 15945 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:34861
I20260811 18:55:53.902150 16133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:34861 every 8 connection(s)
I20260811 18:55:53.902530 15945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:55:53.908782 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 15945
I20260811 18:55:53.908921 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
Aug 11 18:55:53 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474553, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:53.909142 24459 external_mini_cluster.cc:1428] Setting key 3f4aa11f284988084aa1b15330f2563d
I20260811 18:55:53.912911 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:53.903322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:42139 (local address 127.23.226.254:46595)
0811 18:55:53.903406 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:53.903409 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:53.903611 (+ 202us) server_negotiation.cc:407] Connection header received
0811 18:55:53.904096 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:53.904097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:53.904109 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:53.904171 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:53.905115 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:53.905682 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:53.906862 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:53.907091 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:53.907205 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:53.909753 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:53.909756 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:53.909756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:53.909765 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:53.911423 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:53.911889 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:53.911891 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:53.911891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:53.911959 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:53.912227 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:53.912228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:53.912228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:53.912354 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:53.912429 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:53.912726 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 18:55:53.912821 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:55:53.913125 16136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:53.903281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:42139)
0811 18:55:53.903482 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:53.903522 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:53.904009 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:53.904227 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:53.904230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:53.904818 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:53.905017 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:53.905022 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:53.905768 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:53.905769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:53.906745 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:53.906748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:53.907234 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:53.907234 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:53.907341 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:53.907918 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:53.907927 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:53.909649 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:53.911541 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:53.911550 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:53.911552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:53.911806 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:53.912036 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:53.912037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:53.912037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:53.912162 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:53.912421 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:53.912429 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:53.912583 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 18:55:53.912690 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 18:55:53.912863 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":113,"threads_started":1}
I20260811 18:55:53.913662 16134 heartbeater.cc:347] Connected to a master server at 127.23.226.254:46595
I20260811 18:55:53.913789 16134 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:53.913975 16134 heartbeater.cc:511] Master 127.23.226.254:46595 requested a full tablet report, sending...
I20260811 18:55:53.914582 15843 ts_manager.cc:194] Registered new tserver with Master: 4dc5a1f9290f401c821b4dec9352d3fb (127.23.226.193:34861)
I20260811 18:55:53.915629 15843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:42139
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:55:53.938024 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:46595
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:54.022384 16140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:54.022644 16140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:54.022684 16140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:54.023862 16140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:54.023931 16140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:54.023975 16140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:55:54.025471 16140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:54.025755 16140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:54.025983 16140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:54.031087 16150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:54.031080 16148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:54.031106 16147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:54.031423 16140 server_base.cc:1034] running on GCE node
I20260811 18:55:54.031684 16140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:54.031940 16140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:54.033110 16140 hybrid_clock.cc:648] HybridClock initialized: now 1786474554033088 us; error 36 us; skew 500 ppm
Aug 11 18:55:54 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474554, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:54.035876 16140 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:55:54.036362 16140 webserver.cc:460] Webserver started at http://127.23.226.194:46535/ using document root <none> and password file <none>
I20260811 18:55:54.036607 16140 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:54.036674 16140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:54.036823 16140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:54.037899 16140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "afa06f8e138a4db6ad4054f534cb66c7"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "d16f78a1e164b771e395ef39aeb240c2"
server_key_iv: "e6748faafbca6974774089169f985e04"
server_key_version: "encryptionkey@0"
I20260811 18:55:54.038264 16140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "afa06f8e138a4db6ad4054f534cb66c7"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "d16f78a1e164b771e395ef39aeb240c2"
server_key_iv: "e6748faafbca6974774089169f985e04"
server_key_version: "encryptionkey@0"
I20260811 18:55:54.039758 16140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:55:54.040628 16160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:54.040900 16140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:55:54.041021 16140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "afa06f8e138a4db6ad4054f534cb66c7"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "d16f78a1e164b771e395ef39aeb240c2"
server_key_iv: "e6748faafbca6974774089169f985e04"
server_key_version: "encryptionkey@0"
I20260811 18:55:54.041115 16140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:54.055923 16140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:54.059211 16140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:54.059376 16140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:54.059633 16140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:54.059998 16140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:54.060055 16140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:54.060154 16140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:54.060210 16140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:54.069591 16140 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:33821
I20260811 18:55:54.069628 16327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:33821 every 8 connection(s)
I20260811 18:55:54.069988 16140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:55:54.074290 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 16140
I20260811 18:55:54.074426 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:55:54.074621 24459 external_mini_cluster.cc:1428] Setting key fb45528bcb4e9d5bc9bfc51384986ae8
Aug 11 18:55:54 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474554, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:54.081175 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.070824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:36863 (local address 127.23.226.254:46595)
0811 18:55:54.070887 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.070889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.071115 (+ 226us) server_negotiation.cc:407] Connection header received
0811 18:55:54.071652 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.071653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.071665 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.071728 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:54.072757 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.073440 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.074752 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.075069 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.075152 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.077971 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:54.077973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:54.077973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:54.077982 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:54.079505 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:54.080031 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:54.080032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:54.080033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:54.080094 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:54.080428 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:54.080428 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:54.080429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:54.080590 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:54.080655 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.081038 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.081108 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:55:54.081512 16335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.070805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:36863)
0811 18:55:54.070968 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:54.071013 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:54.071559 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:54.071783 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:54.071787 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:54.072451 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:54.072648 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.072654 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.073526 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.073527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.074615 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.074618 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.075157 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.075158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.075334 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.075900 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:54.075911 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:54.077873 (+ 1962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:54.079594 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:54.079603 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:54.079605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:54.079949 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:54.080167 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:54.080168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:54.080168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:54.080352 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:54.080679 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:54.080692 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:54.080885 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 18:55:54.081012 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 18:55:54.081206 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260811 18:55:54.082191 16328 heartbeater.cc:347] Connected to a master server at 127.23.226.254:46595
I20260811 18:55:54.082317 16328 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:54.082531 16328 heartbeater.cc:511] Master 127.23.226.254:46595 requested a full tablet report, sending...
I20260811 18:55:54.082986 15843 ts_manager.cc:194] Registered new tserver with Master: afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
I20260811 18:55:54.083528 15843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:36863
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:55:54.105890 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:46595
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:55:54.198342 16338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:55:54.198725 16338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:55:54.198776 16338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:55:54.200080 16338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:55:54.200153 16338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:55:54.200203 16338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:55:54.201828 16338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:55:54.202114 16338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:55:54.202364 16338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:55:54.208047 16353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:54.208058 16345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:55:54.208057 16344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:55:54.208158 16338 server_base.cc:1034] running on GCE node
I20260811 18:55:54.208565 16338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:55:54.208775 16338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:55:54.209916 16338 hybrid_clock.cc:648] HybridClock initialized: now 1786474554209888 us; error 48 us; skew 500 ppm
Aug 11 18:55:54 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474554, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:55:54.212622 16338 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:55:54.213063 16338 webserver.cc:460] Webserver started at http://127.23.226.195:45257/ using document root <none> and password file <none>
I20260811 18:55:54.213301 16338 fs_manager.cc:359] Metadata directory not provided
I20260811 18:55:54.213367 16338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:55:54.213501 16338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:55:54.214587 16338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "8b2264238603482fa5a84a793c04b4d8"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "432b64392ce44b60a4ef41a8bf952701"
server_key_iv: "f00955c6f632151d487ce525d8f55d35"
server_key_version: "encryptionkey@0"
I20260811 18:55:54.214949 16338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "8b2264238603482fa5a84a793c04b4d8"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "432b64392ce44b60a4ef41a8bf952701"
server_key_iv: "f00955c6f632151d487ce525d8f55d35"
server_key_version: "encryptionkey@0"
I20260811 18:55:54.216271 16338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:55:54.216991 16367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:54.217167 16338 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:55:54.217265 16338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "8b2264238603482fa5a84a793c04b4d8"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "432b64392ce44b60a4ef41a8bf952701"
server_key_iv: "f00955c6f632151d487ce525d8f55d35"
server_key_version: "encryptionkey@0"
I20260811 18:55:54.217341 16338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:55:54.230000 16338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:55:54.231907 16338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:55:54.232064 16338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:55:54.232282 16338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:55:54.232591 16338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:55:54.232650 16338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:54.232692 16338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:55:54.232720 16338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:55:54.238721 16338 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:37475
I20260811 18:55:54.238794 16542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:37475 every 8 connection(s)
I20260811 18:55:54.239108 16338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:55:54.241463 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 16338
I20260811 18:55:54.241607 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:55:54.241788 24459 external_mini_cluster.cc:1428] Setting key 69014e1306ce614a8ec56b8295bf0d2b
Aug 11 18:55:54 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474554, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:55:54.249029 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.240029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:57705 (local address 127.23.226.254:46595)
0811 18:55:54.240117 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.240120 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.240308 (+ 188us) server_negotiation.cc:407] Connection header received
0811 18:55:54.240862 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.240864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.240880 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.240931 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:54.241956 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.242624 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.243919 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.244120 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.244191 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.246526 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:54.246527 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:54.246527 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:54.246534 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:54.247768 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:54.248214 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:54.248215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:54.248215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:54.248270 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:54.248498 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:54.248498 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:54.248498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:54.248599 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:54.248655 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.248902 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.248966 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:55:54.249307 16550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.239954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:57705)
0811 18:55:54.240176 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:54.240224 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:54.240741 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:54.240998 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:54.241002 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:54.241602 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:55:54.241844 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.241850 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.242792 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.242793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.243773 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.243776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.244213 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.244214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.244330 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.244791 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:55:54.244800 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:55:54.246391 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:55:54.247844 (+ 1453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:54.247851 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:54.247853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:54.248140 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:54.248336 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:55:54.248337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:55:54.248337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:55:54.248442 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:55:54.248664 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:55:54.248669 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:55:54.248789 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 18:55:54.248880 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:55:54.249004 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":98,"threads_started":1}
I20260811 18:55:54.249886 16545 heartbeater.cc:347] Connected to a master server at 127.23.226.254:46595
I20260811 18:55:54.249979 16545 heartbeater.cc:464] Registering TS with master...
I20260811 18:55:54.250136 16545 heartbeater.cc:511] Master 127.23.226.254:46595 requested a full tablet report, sending...
I20260811 18:55:54.250535 15843 ts_manager.cc:194] Registered new tserver with Master: 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475)
I20260811 18:55:54.250906 15843 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:57705
I20260811 18:55:54.253794 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:55:54.261525 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.255243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43560 (local address 127.23.226.254:46595)
0811 18:55:54.255294 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.255296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.255436 (+ 140us) server_negotiation.cc:407] Connection header received
0811 18:55:54.255510 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.255511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.255521 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.255570 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:55:54.256096 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.256592 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.257300 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.257496 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.257568 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.258768 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:55:54.258770 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:55:54.258770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:55:54.258777 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:55:54.260219 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:54.260606 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:54.260607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:54.260608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:54.260673 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:55:54.260883 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:55:54.260885 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:55:54.260885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:55:54.261053 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:55:54.261177 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.261331 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.261416 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:55:54.263228 15843 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43560:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:55:54.264931 15843 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:55:54.272219 16567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.267753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34861 (local address 127.0.0.1:34532)
0811 18:55:54.267945 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:54.267955 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:54.268004 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:54.268616 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:54.268616 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:54.268618 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:54.268655 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.268656 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.269939 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.269940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.271019 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.271022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.271871 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.271872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.271954 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.271969 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:55:54.272058 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:55:54.272119 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":8,"thread_start_us":94,"threads_started":1}
I20260811 18:55:54.272250 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.268041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34532 (local address 127.23.226.193:34861)
0811 18:55:54.268454 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.268459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.268470 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:55:54.268513 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.268515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.268530 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.268610 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:54.268712 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.269853 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.271144 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.271791 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.271873 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.271934 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.272076 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.272119 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":84,"threads_started":1}
I20260811 18:55:54.272631 16571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.267504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:33821 (local address 127.0.0.1:47886)
0811 18:55:54.267898 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:54.267911 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:54.267966 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:54.268390 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:54.268391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:54.268394 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:54.268440 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.268441 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.269778 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.269779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.271323 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.271324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.272352 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.272353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.272438 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.272442 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:55:54.272496 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:55:54.272542 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":116,"thread_start_us":105,"threads_started":1}
I20260811 18:55:54.272941 16574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.267741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47886 (local address 127.23.226.194:33821)
0811 18:55:54.268109 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.268113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.268123 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:55:54.268204 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.268206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.268223 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.268298 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:54.268524 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.269650 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.271433 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.272172 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.272253 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.272310 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.272805 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.272852 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":109,"threads_started":1}
I20260811 18:55:54.273135 16570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.267593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45676 (local address 127.23.226.195:37475)
0811 18:55:54.268055 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.268085 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.268096 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:55:54.268143 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.268146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.268164 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.268246 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:54.268460 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.269736 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.271433 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.272212 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.272272 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.272953 (+ 681us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.272982 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.273033 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":96,"threads_started":1}
I20260811 18:55:54.272867 16569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.267500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37475 (local address 127.0.0.1:45676)
0811 18:55:54.267674 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:54.267722 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:54.267795 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:54.268265 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:54.268269 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:54.268272 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:54.268359 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.268362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.269853 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.269854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.271321 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.271324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.272642 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.272643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.272708 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.272713 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:55:54.272766 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:55:54.272808 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":115,"thread_start_us":80,"threads_started":1}
I20260811 18:55:54.273134 16044 tablet_service.cc:1467] Processing CreateTablet for tablet 4a08da5c2a7f4ca8ac78601e3533cde8 (DEFAULT_TABLE table=test-table [id=5332ed4a35804410a912d2d22c2ae986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:54.273541 16044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a08da5c2a7f4ca8ac78601e3533cde8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:54.273808 16443 tablet_service.cc:1467] Processing CreateTablet for tablet 4a08da5c2a7f4ca8ac78601e3533cde8 (DEFAULT_TABLE table=test-table [id=5332ed4a35804410a912d2d22c2ae986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:54.274072 16443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a08da5c2a7f4ca8ac78601e3533cde8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:54.276419 16577 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Bootstrap starting.
I20260811 18:55:54.276965 16578 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: Bootstrap starting.
I20260811 18:55:54.277000 16238 tablet_service.cc:1467] Processing CreateTablet for tablet 4a08da5c2a7f4ca8ac78601e3533cde8 (DEFAULT_TABLE table=test-table [id=5332ed4a35804410a912d2d22c2ae986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:55:54.277211 16577 tablet_bootstrap.cc:654] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:54.277320 16238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a08da5c2a7f4ca8ac78601e3533cde8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:55:54.277679 16578 tablet_bootstrap.cc:654] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:54.277863 16577 log.cc:824] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:54.278231 16578 log.cc:824] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:54.278782 16577 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: No bootstrap required, opened a new log
I20260811 18:55:54.278878 16577 ts_tablet_manager.cc:1397] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:55:54.279021 16578 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: No bootstrap required, opened a new log
I20260811 18:55:54.279106 16578 ts_tablet_manager.cc:1397] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:55:54.280480 16582 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Bootstrap starting.
I20260811 18:55:54.280604 16577 raft_consensus.cc:348] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.280812 16577 raft_consensus.cc:374] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:54.280870 16577 raft_consensus.cc:729] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc5a1f9290f401c821b4dec9352d3fb, State: Initialized, Role: FOLLOWER
I20260811 18:55:54.281028 16577 consensus_queue.cc:260] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.281083 16578 raft_consensus.cc:348] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.281240 16582 tablet_bootstrap.cc:654] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Neither blocks nor log segments found. Creating new log.
I20260811 18:55:54.281283 16578 raft_consensus.cc:374] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:54.281318 16577 ts_tablet_manager.cc:1428] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:55:54.281334 16578 raft_consensus.cc:729] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b2264238603482fa5a84a793c04b4d8, State: Initialized, Role: FOLLOWER
I20260811 18:55:54.281459 16134 heartbeater.cc:503] Master 127.23.226.254:46595 was elected leader, sending a full tablet report...
I20260811 18:55:54.281450 16578 consensus_queue.cc:260] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.281752 16578 ts_tablet_manager.cc:1428] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:55:54.281802 16545 heartbeater.cc:503] Master 127.23.226.254:46595 was elected leader, sending a full tablet report...
I20260811 18:55:54.281853 16582 log.cc:824] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Log is configured to *not* fsync() on all Append() calls
I20260811 18:55:54.282620 16582 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: No bootstrap required, opened a new log
I20260811 18:55:54.282712 16582 ts_tablet_manager.cc:1397] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:55:54.284147 16582 raft_consensus.cc:348] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.284276 16582 raft_consensus.cc:374] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:55:54.284297 16582 raft_consensus.cc:729] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa06f8e138a4db6ad4054f534cb66c7, State: Initialized, Role: FOLLOWER
I20260811 18:55:54.284425 16582 consensus_queue.cc:260] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.284691 16582 ts_tablet_manager.cc:1428] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 18:55:54.284708 16328 heartbeater.cc:503] Master 127.23.226.254:46595 was elected leader, sending a full tablet report...
W20260811 18:55:54.320607 16332 tablet.cc:2369] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:55:54.381632 16584 raft_consensus.cc:482] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:55:54.381781 16584 raft_consensus.cc:504] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.382278 16584 leader_election.cc:288] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
I20260811 18:55:54.386945 16574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.382620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:57401 (local address 127.23.226.194:33821)
0811 18:55:54.382696 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.382699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.382877 (+ 178us) server_negotiation.cc:407] Connection header received
0811 18:55:54.382909 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.382910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.382920 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.382983 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:54.383158 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.383994 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.385787 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.386515 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.386626 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.386638 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.386816 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.386870 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 18:55:54.386956 16588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.382606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:33821 (local address 127.23.226.193:57401)
0811 18:55:54.382770 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:54.382787 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:54.382837 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:54.382994 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:54.382995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:54.382997 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:54.383082 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.383084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.384128 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.384130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.385652 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.385657 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.386646 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.386647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.386733 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.386739 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 18:55:54.386805 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 18:55:54.386859 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":13,"thread_start_us":86,"threads_started":1}
I20260811 18:55:54.387077 16136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.382507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37475 (local address 127.23.226.193:41465)
0811 18:55:54.382587 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:54.382606 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:55:54.382670 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:55:54.382925 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:55:54.382926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:55:54.382928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:55:54.383036 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.383039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.384128 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.384130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.385674 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:55:54.385676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.386697 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.386699 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:55:54.386822 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.386827 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:55:54.386888 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 18:55:54.386939 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":129}
I20260811 18:55:54.387123 16570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.382713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:41465 (local address 127.23.226.195:37475)
0811 18:55:54.382768 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.382770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.382780 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:55:54.382808 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.382808 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.382817 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.382906 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:55:54.383149 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.383982 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.385788 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.386536 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.386643 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.386653 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.386985 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.387036 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 18:55:54.387485 16265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a08da5c2a7f4ca8ac78601e3533cde8" candidate_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa06f8e138a4db6ad4054f534cb66c7" is_pre_election: true
I20260811 18:55:54.387584 16473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a08da5c2a7f4ca8ac78601e3533cde8" candidate_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b2264238603482fa5a84a793c04b4d8" is_pre_election: true
I20260811 18:55:54.387688 16265 raft_consensus.cc:2454] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dc5a1f9290f401c821b4dec9352d3fb in term 0.
I20260811 18:55:54.387773 16473 raft_consensus.cc:2454] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dc5a1f9290f401c821b4dec9352d3fb in term 0.
I20260811 18:55:54.387972 15967 leader_election.cc:302] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dc5a1f9290f401c821b4dec9352d3fb, afa06f8e138a4db6ad4054f534cb66c7; no voters:
I20260811 18:55:54.388121 16584 raft_consensus.cc:2781] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:55:54.388183 16584 raft_consensus.cc:482] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:55:54.388218 16584 raft_consensus.cc:3037] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:54.388994 16584 raft_consensus.cc:504] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.389189 16584 leader_election.cc:288] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 1 election: Requested vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
I20260811 18:55:54.389364 16473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a08da5c2a7f4ca8ac78601e3533cde8" candidate_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b2264238603482fa5a84a793c04b4d8"
I20260811 18:55:54.389389 16265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a08da5c2a7f4ca8ac78601e3533cde8" candidate_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa06f8e138a4db6ad4054f534cb66c7"
I20260811 18:55:54.389468 16473 raft_consensus.cc:3037] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:54.389463 16265 raft_consensus.cc:3037] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:55:54.390281 16473 raft_consensus.cc:2454] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dc5a1f9290f401c821b4dec9352d3fb in term 1.
I20260811 18:55:54.390292 16265 raft_consensus.cc:2454] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dc5a1f9290f401c821b4dec9352d3fb in term 1.
I20260811 18:55:54.390496 15969 leader_election.cc:302] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dc5a1f9290f401c821b4dec9352d3fb, 8b2264238603482fa5a84a793c04b4d8; no voters:
I20260811 18:55:54.390617 16584 raft_consensus.cc:2781] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:55:54.390797 16584 raft_consensus.cc:686] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 LEADER]: Becoming Leader. State: Replica: 4dc5a1f9290f401c821b4dec9352d3fb, State: Running, Role: LEADER
I20260811 18:55:54.390910 16584 consensus_queue.cc:237] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:55:54.391887 15843 catalog_manager.cc:5495] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dc5a1f9290f401c821b4dec9352d3fb (127.23.226.193). New cstate: current_term: 1 leader_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } health_report { overall_health: UNKNOWN } } }
W20260811 18:55:54.403263 16135 tablet.cc:2369] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:55:54.421183 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.418356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34544 (local address 127.23.226.193:34861)
0811 18:55:54.418459 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 18:55:54.418462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:55:54.418475 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:55:54.418525 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:55:54.418526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:55:54.418570 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:55:54.418654 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:55:54.418842 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.419370 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.420280 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:55:54.420495 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:55:54.420594 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:55:54.420798 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:55:54.420905 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:55:54.420996 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 18:55:54.421042 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 18:55:54.421067 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 18:55:54.423398 16265 raft_consensus.cc:1261] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 1 FOLLOWER]: Refusing update from remote peer 4dc5a1f9290f401c821b4dec9352d3fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:54.423431 16473 raft_consensus.cc:1261] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 1 FOLLOWER]: Refusing update from remote peer 4dc5a1f9290f401c821b4dec9352d3fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:55:54.423797 16590 consensus_queue.cc:1035] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:54.423972 16584 consensus_queue.cc:1035] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:55:54.426717 16595 mvcc.cc:205] Tried to move back new op lower bound from 7317399774914682880 to 7317399774786039808. Current Snapshot: MvccSnapshot[applied={T|T < 7317399774914682880}]
I20260811 18:55:54.426878 16596 mvcc.cc:205] Tried to move back new op lower bound from 7317399774914682880 to 7317399774786039808. Current Snapshot: MvccSnapshot[applied={T|T < 7317399774914682880}]
I20260811 18:55:54.427327 16602 mvcc.cc:205] Tried to move back new op lower bound from 7317399774914682880 to 7317399774786039808. Current Snapshot: MvccSnapshot[applied={T|T < 7317399774914682880}]
I20260811 18:55:54.429217 15843 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:54.429316 15843 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:55:54.430085 15843 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Sending DeleteTablet for 3 replicas of tablet 4a08da5c2a7f4ca8ac78601e3533cde8
I20260811 18:55:54.430472 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 15945
I20260811 18:55:54.430480 16044 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a08da5c2a7f4ca8ac78601e3533cde8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34532
I20260811 18:55:54.430485 16238 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a08da5c2a7f4ca8ac78601e3533cde8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:47886
I20260811 18:55:54.433380 16443 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a08da5c2a7f4ca8ac78601e3533cde8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:45676
I20260811 18:55:54.435894 16614 tablet_replica.cc:330] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: stopping tablet replica
I20260811 18:55:54.436004 16614 raft_consensus.cc:2229] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:54.436093 16614 raft_consensus.cc:2258] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:54.437822 16614 ts_tablet_manager.cc:1905] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:54.439493 16614 ts_tablet_manager.cc:1918] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:54.439569 16614 log.cc:1196] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/4a08da5c2a7f4ca8ac78601e3533cde8
I20260811 18:55:54.439805 16614 ts_tablet_manager.cc:1939] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 8b2264238603482fa5a84a793c04b4d8: Deleting consensus metadata
I20260811 18:55:54.440253 15820 catalog_manager.cc:4841] TS 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475): tablet 4a08da5c2a7f4ca8ac78601e3533cde8 (table test-table [id=5332ed4a35804410a912d2d22c2ae986]) successfully deleted
I20260811 18:55:54.445698 16613 tablet_replica.cc:330] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: stopping tablet replica
I20260811 18:55:54.445861 16613 raft_consensus.cc:2229] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:55:54.446024 16613 raft_consensus.cc:2258] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:55:54.446553 16613 ts_tablet_manager.cc:1905] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:55:54.448225 16613 ts_tablet_manager.cc:1918] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:55:54.448328 16613 log.cc:1196] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/4a08da5c2a7f4ca8ac78601e3533cde8
I20260811 18:55:54.448639 16613 ts_tablet_manager.cc:1939] T 4a08da5c2a7f4ca8ac78601e3533cde8 P afa06f8e138a4db6ad4054f534cb66c7: Deleting consensus metadata
I20260811 18:55:54.449143 15815 catalog_manager.cc:4841] TS afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821): tablet 4a08da5c2a7f4ca8ac78601e3533cde8 (table test-table [id=5332ed4a35804410a912d2d22c2ae986]) successfully deleted
W20260811 18:55:54.450103 15820 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:34861 (error 108)
I20260811 18:55:54.450387 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 16140
I20260811 18:55:54.452370 16569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:55:54.450643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34861 (local address 127.0.0.1:34546)
0811 18:55:54.452296 (+ 1653us) negotiation.cc:107] Waiting for socket to connect
0811 18:55:54.452338 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1627}
W20260811 18:55:54.452536 15820 catalog_manager.cc:4584] TS 4dc5a1f9290f401c821b4dec9352d3fb (127.23.226.193:34861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a08da5c2a7f4ca8ac78601e3533cde8: Network error: Client connection negotiation failed: client connection to 127.23.226.193:34861: connect: Connection refused (error 111)
I20260811 18:55:54.459712 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 16338
I20260811 18:55:54.472216 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 15794
I20260811 18:56:14.484565 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46595
--webserver_interface=127.23.226.254
--webserver_port=37589
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:46595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:14.572353 16617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:14.572544 16617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:14.572566 16617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:14.573724 16617 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:56:14.573764 16617 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:56:14.573777 16617 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:56:14.573789 16617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:14.573824 16617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:14.573858 16617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:14.573874 16617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:14.573895 16617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:14.575449 16617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:46595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=37589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:14.575732 16617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:14.575981 16617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:56:14.586333 16617 server_base.cc:1034] running on GCE node
W20260811 18:56:14.586272 16624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:14.586261 16625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:14.586258 16627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:14.586891 16617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:14.587237 16617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:14.588413 16617 hybrid_clock.cc:648] HybridClock initialized: now 1786474574588392 us; error 42 us; skew 500 ppm
Aug 11 18:56:14 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474574, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:14.597771 16617 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:56:14.598344 16617 webserver.cc:460] Webserver started at http://127.23.226.254:37589/ using document root <none> and password file <none>
I20260811 18:56:14.598644 16617 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:14.598740 16617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:14.600244 16617 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:14.601078 16637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:14.601387 16617 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:14.601536 16617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "6c13883e957341599e3da58be323192a"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "d0306a4aa20005dd997021dbbfcf53cc"
server_key_iv: "daad93d1f9a9dc030c74bcd5e056af91"
server_key_version: "encryptionkey@0"
I20260811 18:56:14.601984 16617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:14.612465 16617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:14.614722 16617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:14.614894 16617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:14.619103 16617 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:46595
I20260811 18:56:14.619215 16715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:46595 every 8 connection(s)
I20260811 18:56:14.619585 16617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:14.621153 16716 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:56:14.621158 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 16617
I20260811 18:56:14.621443 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:34861
--local_ip_for_outbound_sockets=127.23.226.193
--tserver_master_addrs=127.23.226.254:46595
--webserver_port=37457
--webserver_interface=127.23.226.193
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:56:14.621953 16716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Bootstrap starting.
I20260811 18:56:14.631569 16716 log.cc:824] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:14.633627 16716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:56:14.633967 16716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Bootstrap complete.
I20260811 18:56:14.636432 16716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:56:14.636675 16716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c13883e957341599e3da58be323192a, State: Initialized, Role: FOLLOWER
I20260811 18:56:14.636847 16716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:56:14.636920 16716 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:14.636986 16716 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:14.637041 16716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 1 FOLLOWER]: Advancing to term 2
I20260811 18:56:14.638104 16716 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:56:14.638197 16716 leader_election.cc:302] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c13883e957341599e3da58be323192a; no voters:
I20260811 18:56:14.638392 16716 leader_election.cc:288] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 18:56:14.638458 16723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 2 FOLLOWER]: Leader election won for term 2
I20260811 18:56:14.638649 16723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 2 LEADER]: Becoming Leader. State: Replica: 6c13883e957341599e3da58be323192a, State: Running, Role: LEADER
I20260811 18:56:14.638717 16716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:14.638796 16723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:56:14.639118 16724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6c13883e957341599e3da58be323192a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } } }
I20260811 18:56:14.639115 16723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c13883e957341599e3da58be323192a. Latest consensus state: current_term: 2 leader_uuid: "6c13883e957341599e3da58be323192a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } } }
I20260811 18:56:14.639281 16724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:14.639312 16723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:14.639807 16738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:14.640647 16738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:56:14.640939 16738 catalog_manager.cc:1259] Loaded cluster ID: a308b14cfdcd4c80a04221b76a35c9ad
I20260811 18:56:14.641023 16738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:56:14.642225 16738 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:14.642454 16738 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Loaded TSK: 0
I20260811 18:56:14.652455 16738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Generated new TSK 1
I20260811 18:56:14.652565 16738 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:56:14.712642 16721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:14.712843 16721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:14.712867 16721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:14.714037 16721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:14.714080 16721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:14.714107 16721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:56:14.715658 16721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:34861
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=37457
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:14.715907 16721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:14.716163 16721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:14.722141 16761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:14.722330 16763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:14.722146 16760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:14.722520 16721 server_base.cc:1034] running on GCE node
I20260811 18:56:14.722743 16721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:14.722994 16721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:14.724170 16721 hybrid_clock.cc:648] HybridClock initialized: now 1786474574724158 us; error 34 us; skew 500 ppm
Aug 11 18:56:14 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474574, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:14.726966 16721 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:56:14.727523 16721 webserver.cc:460] Webserver started at http://127.23.226.193:37457/ using document root <none> and password file <none>
I20260811 18:56:14.727813 16721 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:14.727906 16721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:14.729718 16721 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:56:14.730557 16778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:14.730747 16721 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:14.730840 16721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "4dc5a1f9290f401c821b4dec9352d3fb"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "15608b350263a222608b9b791ad87c17"
server_key_iv: "b2ac74500fc763f5153ebe45a7e1b22f"
server_key_version: "encryptionkey@0"
I20260811 18:56:14.731292 16721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:14.744508 16721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:14.747162 16721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:14.747324 16721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:14.747602 16721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:14.748119 16786 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 18:56:14.749729 16721 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 18:56:14.749794 16721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 18:56:14.749828 16721 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 18:56:14.750737 16721 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 18:56:14.750787 16721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:14.750883 16786 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Bootstrap starting.
I20260811 18:56:14.758642 16721 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:34861
I20260811 18:56:14.758772 16945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:34861 every 8 connection(s)
I20260811 18:56:14.759160 16721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:56:14.763118 16786 log.cc:824] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:14.766189 16786 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:56:14.766558 16786 tablet_bootstrap.cc:492] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Bootstrap complete.
I20260811 18:56:14.767976 16786 ts_tablet_manager.cc:1397] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.013s
I20260811 18:56:14.767997 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 16721
I20260811 18:56:14.768474 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:33821
--local_ip_for_outbound_sockets=127.23.226.194
--tserver_master_addrs=127.23.226.254:46595
--webserver_port=46535
--webserver_interface=127.23.226.194
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:56:14.769536 16786 raft_consensus.cc:348] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
I20260811 18:56:14.769847 16786 raft_consensus.cc:729] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc5a1f9290f401c821b4dec9352d3fb, State: Initialized, Role: FOLLOWER
I20260811 18:56:14.769979 16786 consensus_queue.cc:260] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } }
Aug 11 18:56:14 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474574, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:14.770263 16786 ts_tablet_manager.cc:1428] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:56:14.775682 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:14.760019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:59111 (local address 127.23.226.254:46595)
0811 18:56:14.760244 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:14.760254 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:14.762774 (+ 2520us) server_negotiation.cc:407] Connection header received
0811 18:56:14.763572 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:14.763579 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:14.763641 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:14.763789 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:14.764563 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.765588 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.767018 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.767495 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.767645 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:14.770863 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:14.770869 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:14.770869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:14.770883 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:14.773400 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:14.773955 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:14.773959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:14.773959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:14.774103 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:14.774496 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:14.774497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:14.774497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:14.774818 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:14.774906 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:14.775333 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 18:56:14.775471 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":102,"threads_started":1}
I20260811 18:56:14.775828 16949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:14.759905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:59111)
0811 18:56:14.762554 (+ 2649us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:14.762608 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:14.763280 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:14.763869 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:14.763875 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:14.764210 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:14.764416 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:14.764422 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.765749 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.765752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:14.766903 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:14.766906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.767608 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.767609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:14.767766 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:14.768499 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:14.768511 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:14.770714 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:14.773500 (+ 2786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:14.773507 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:14.773509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:14.773808 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:14.774204 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:14.774205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:14.774206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:14.774371 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:14.774904 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:14.774913 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:14.775107 (+ 194us) client_negotiation.cc:769] Sending connection context
0811 18:56:14.775240 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 18:56:14.775457 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2597,"thread_start_us":107,"threads_started":1}
I20260811 18:56:14.776947 16946 heartbeater.cc:347] Connected to a master server at 127.23.226.254:46595
I20260811 18:56:14.777067 16946 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:14.777298 16946 heartbeater.cc:511] Master 127.23.226.254:46595 requested a full tablet report, sending...
I20260811 18:56:14.778301 16658 ts_manager.cc:194] Registered new tserver with Master: 4dc5a1f9290f401c821b4dec9352d3fb (127.23.226.193:34861)
I20260811 18:56:14.779491 16658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:59111
I20260811 18:56:14.780655 16946 heartbeater.cc:503] Master 127.23.226.254:46595 was elected leader, sending a full tablet report...
I20260811 18:56:14.787516 16958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:14.779011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34861 (local address 127.0.0.1:38028)
0811 18:56:14.782571 (+ 3560us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:14.782620 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:14.782708 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:14.782992 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:14.782995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:14.782998 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:14.783061 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:14.783062 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.784579 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.784580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:14.786048 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:14.786051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.787195 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.787196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:14.787289 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:14.787303 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 18:56:14.787373 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:56:14.787427 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3510,"thread_start_us":104,"threads_started":1}
I20260811 18:56:14.787911 16959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:14.779349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38028 (local address 127.23.226.193:34861)
0811 18:56:14.779536 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:14.779541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:14.782810 (+ 3269us) server_negotiation.cc:407] Connection header received
0811 18:56:14.782855 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:14.782857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:14.782878 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:14.782971 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:14.783160 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.784455 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.786160 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.787018 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.787097 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:14.787154 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:14.787794 (+ 640us) server_negotiation.cc:299] Negotiation successful
0811 18:56:14.787841 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":92,"threads_started":1}
I20260811 18:56:14.788524 16852 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a08da5c2a7f4ca8ac78601e3533cde8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:55:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:38028
I20260811 18:56:14.789214 16960 tablet_replica.cc:330] stopping tablet replica
I20260811 18:56:14.789331 16960 raft_consensus.cc:2229] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:14.789400 16960 raft_consensus.cc:2258] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:14.789750 16960 ts_tablet_manager.cc:1905] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:14.791925 16960 ts_tablet_manager.cc:1918] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:14.791989 16960 log.cc:1196] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal/wals/4a08da5c2a7f4ca8ac78601e3533cde8
I20260811 18:56:14.792281 16960 ts_tablet_manager.cc:1939] T 4a08da5c2a7f4ca8ac78601e3533cde8 P 4dc5a1f9290f401c821b4dec9352d3fb: Deleting consensus metadata
I20260811 18:56:14.792804 16642 catalog_manager.cc:4841] TS 4dc5a1f9290f401c821b4dec9352d3fb (127.23.226.193:34861): tablet 4a08da5c2a7f4ca8ac78601e3533cde8 (table test-table [id=5332ed4a35804410a912d2d22c2ae986]) successfully deleted
W20260811 18:56:14.863987 16955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:14.864246 16955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:14.864288 16955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:14.865459 16955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:14.865532 16955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:14.865574 16955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:56:14.867148 16955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:33821
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=46535
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:14.867437 16955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:14.867681 16955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:14.872932 16966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:14.872939 16975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:14.872958 16967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:14.873112 16955 server_base.cc:1034] running on GCE node
I20260811 18:56:14.873409 16955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:14.873661 16955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:14.874838 16955 hybrid_clock.cc:648] HybridClock initialized: now 1786474574874809 us; error 62 us; skew 500 ppm
Aug 11 18:56:14 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474574, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:14.877539 16955 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:56:14.877987 16955 webserver.cc:460] Webserver started at http://127.23.226.194:46535/ using document root <none> and password file <none>
I20260811 18:56:14.878237 16955 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:14.878325 16955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:14.879801 16955 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:14.880450 16986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:14.880648 16955 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:14.880757 16955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "afa06f8e138a4db6ad4054f534cb66c7"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "d16f78a1e164b771e395ef39aeb240c2"
server_key_iv: "e6748faafbca6974774089169f985e04"
server_key_version: "encryptionkey@0"
I20260811 18:56:14.881105 16955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:14.895828 16955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:14.898216 16955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:14.898386 16955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:14.898684 16955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:14.899008 16955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:14.899063 16955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:14.899099 16955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:14.899127 16955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:14.905452 16955 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:33821
I20260811 18:56:14.905486 17171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:33821 every 8 connection(s)
I20260811 18:56:14.905887 16955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:56:14.906522 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 16955
I20260811 18:56:14.906864 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:37475
--local_ip_for_outbound_sockets=127.23.226.195
--tserver_master_addrs=127.23.226.254:46595
--webserver_port=45257
--webserver_interface=127.23.226.195
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 18:56:14 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474574, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:14.916743 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:14.906714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:35245)
0811 18:56:14.906896 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:14.906939 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:14.907468 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:14.907730 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:14.907734 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:14.908324 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:14.908644 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:14.908653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.909421 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.909422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:14.910348 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:14.910351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.910785 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.910786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:14.910944 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:14.911470 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:14.911481 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:14.913210 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:14.915266 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:14.915273 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:14.915275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:14.915512 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:14.915760 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:14.915761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:14.915761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:14.915876 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:14.916222 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:14.916229 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:14.916351 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 18:56:14.916437 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 18:56:14.916571 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":111,"threads_started":1}
I20260811 18:56:14.916754 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:14.906674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:35245 (local address 127.23.226.254:46595)
0811 18:56:14.906742 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:14.906745 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:14.907023 (+ 278us) server_negotiation.cc:407] Connection header received
0811 18:56:14.907582 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:14.907584 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:14.907601 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:14.907659 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:14.908759 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.909314 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.910478 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:14.910694 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:14.910752 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:14.913310 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:14.913312 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:14.913312 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:14.913321 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:14.915145 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:14.915602 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:14.915603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:14.915603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:14.915683 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:14.915950 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:14.915952 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:14.915953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:14.916123 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:14.916203 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:14.916492 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 18:56:14.916604 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:56:14.917384 17172 heartbeater.cc:347] Connected to a master server at 127.23.226.254:46595
I20260811 18:56:14.917505 17172 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:14.917734 17172 heartbeater.cc:511] Master 127.23.226.254:46595 requested a full tablet report, sending...
I20260811 18:56:14.918181 16658 ts_manager.cc:194] Registered new tserver with Master: afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
I20260811 18:56:14.918650 16658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:35245
W20260811 18:56:15.005452 17179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:15.005750 17179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:15.005801 17179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:15.008013 17179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:15.008090 17179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:15.008138 17179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:56:15.010807 17179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:37475
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=45257
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:15.011098 17179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:15.011413 17179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:15.018464 17189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:15.018451 17185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:15.018447 17186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:15.018934 17179 server_base.cc:1034] running on GCE node
I20260811 18:56:15.019104 17179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:15.019301 17179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:15.020462 17179 hybrid_clock.cc:648] HybridClock initialized: now 1786474575020427 us; error 40 us; skew 500 ppm
Aug 11 18:56:15 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474575, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:15.023698 17179 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:56:15.024360 17179 webserver.cc:460] Webserver started at http://127.23.226.195:45257/ using document root <none> and password file <none>
I20260811 18:56:15.024713 17179 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:15.024811 17179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:15.027037 17179 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:56:15.027760 17199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:15.027964 17179 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:15.028060 17179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "8b2264238603482fa5a84a793c04b4d8"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "432b64392ce44b60a4ef41a8bf952701"
server_key_iv: "f00955c6f632151d487ce525d8f55d35"
server_key_version: "encryptionkey@0"
I20260811 18:56:15.028559 17179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:15.050720 17179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:15.053049 17179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:15.053186 17179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:15.053431 17179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:15.053815 17179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:15.053856 17179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:15.053908 17179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:15.053962 17179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:15.061244 17179 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:37475
I20260811 18:56:15.061404 17380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:37475 every 8 connection(s)
I20260811 18:56:15.061830 17179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:56:15.065164 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 17179
Aug 11 18:56:15 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474575, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:15.074857 17385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.065644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55072 (local address 127.23.226.254:46595)
0811 18:56:15.065773 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.065776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.066276 (+ 500us) server_negotiation.cc:407] Connection header received
0811 18:56:15.066357 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.066358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.066371 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.066467 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:15.067184 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.067968 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.069312 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.069547 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.069660 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.071481 (+ 1821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:15.071482 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:15.071482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:15.071489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:15.073520 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:15.073913 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:15.073915 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:15.073915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:15.073984 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:15.074244 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:15.074245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:15.074246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:15.074358 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:15.074568 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:15.074649 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 18:56:15.074756 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":71,"threads_started":1}
I20260811 18:56:15.076427 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.062975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:60835 (local address 127.23.226.254:46595)
0811 18:56:15.063062 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.063064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.064951 (+ 1887us) server_negotiation.cc:407] Connection header received
0811 18:56:15.066103 (+ 1152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.066104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.066120 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.066195 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:15.067464 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.068125 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.069626 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.069919 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.069974 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.072890 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:15.072892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:15.072892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:15.072901 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:15.074784 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:15.075284 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:15.075285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:15.075286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:15.075351 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:15.075742 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:15.075743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:15.075744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:15.075863 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:15.075938 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:15.076248 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 18:56:15.076333 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:56:15.076694 17384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.062880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:60835)
0811 18:56:15.064672 (+ 1792us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:15.064724 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:15.065955 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:15.066377 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:15.066382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:15.067156 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:15.067369 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.067374 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.068221 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.068222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.069536 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.069539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.070016 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.070017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.070170 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.070708 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:15.070720 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:15.072786 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:15.074867 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:15.074875 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:15.074878 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:15.075191 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:15.075427 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:15.075428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:15.075429 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:15.075551 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:15.075944 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:15.075961 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:15.076105 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 18:56:15.076234 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 18:56:15.076405 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1739,"thread_start_us":1678,"threads_started":1}
I20260811 18:56:15.077248 17381 heartbeater.cc:347] Connected to a master server at 127.23.226.254:46595
I20260811 18:56:15.077358 17381 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:15.077548 17381 heartbeater.cc:511] Master 127.23.226.254:46595 requested a full tablet report, sending...
I20260811 18:56:15.077989 16658 ts_manager.cc:194] Registered new tserver with Master: 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475)
I20260811 18:56:15.078629 16658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:60835
I20260811 18:56:15.086777 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:56:15.089956 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.087245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55074 (local address 127.23.226.254:46595)
0811 18:56:15.087316 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.087319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.087436 (+ 117us) server_negotiation.cc:407] Connection header received
0811 18:56:15.087528 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.087528 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.087578 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.087658 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:56:15.087831 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.088339 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.089137 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.089336 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.089412 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.089611 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:56:15.089659 (+ 48us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 18:56:15.089853 (+ 194us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55074: token expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 18:56:15.090026 16950 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55074: token expired
W20260811 18:56:15.090260 16551 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.23.226.254:46595)
I20260811 18:56:15.096484 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.090599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55078 (local address 127.23.226.254:46595)
0811 18:56:15.090654 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.090656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.090667 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:56:15.090702 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.090702 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.090710 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.090764 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:15.091300 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.091745 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.092401 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.092586 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.092636 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.093888 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:15.093889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:15.093890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:15.093896 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:15.095379 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:15.095763 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:15.095764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:15.095764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:15.095818 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:15.096035 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:15.096035 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:15.096036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:15.096165 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:15.096269 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:15.096361 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 18:56:15.096422 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 18:56:15.097774 16658 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:56:15.099653 16658 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:56:15.102177 16852 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfc821bc82341e9a051a642d147c99d (DEFAULT_TABLE table=test-table [id=713e823706de4a4b97ed376729a2b384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:15.102437 16852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfc821bc82341e9a051a642d147c99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:15.103931 16786 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Bootstrap starting.
I20260811 18:56:15.104281 16786 tablet_bootstrap.cc:654] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:15.104959 16786 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: No bootstrap required, opened a new log
I20260811 18:56:15.105010 16786 ts_tablet_manager.cc:1397] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:15.105139 16786 raft_consensus.cc:348] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.105229 16786 raft_consensus.cc:374] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:15.105288 16786 raft_consensus.cc:729] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc5a1f9290f401c821b4dec9352d3fb, State: Initialized, Role: FOLLOWER
I20260811 18:56:15.105341 16786 consensus_queue.cc:260] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.105443 16786 ts_tablet_manager.cc:1428] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:15.106225 16958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.101690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:33821 (local address 127.0.0.1:60462)
0811 18:56:15.101882 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:15.101894 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:15.101939 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:15.102385 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:15.102386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:15.102388 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:15.102450 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.102452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.103892 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.103894 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.104927 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.104931 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.106013 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.106014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.106067 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.106070 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:56:15.106100 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 18:56:15.106146 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":3}
I20260811 18:56:15.106349 17391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.101989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59898 (local address 127.23.226.195:37475)
0811 18:56:15.102200 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.102203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.102275 (+ 72us) server_negotiation.cc:407] Connection header received
0811 18:56:15.102454 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.102457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.102474 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.102549 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:15.102645 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.103753 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.105262 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.105976 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.106039 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.106100 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:15.106206 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 18:56:15.106259 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":108,"threads_started":1}
I20260811 18:56:15.106381 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.101758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37475 (local address 127.0.0.1:59898)
0811 18:56:15.102207 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:15.102218 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:15.102288 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:15.102555 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:15.102556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:15.102558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:15.102594 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.102595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.103857 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.103868 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.105127 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.105130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.106050 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.106051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.106115 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.106120 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:56:15.106192 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 18:56:15.106228 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":44,"thread_start_us":57,"threads_started":1}
I20260811 18:56:15.106732 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.101887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60462 (local address 127.23.226.194:33821)
0811 18:56:15.102133 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.102138 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.102149 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:56:15.102197 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.102199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.102217 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.102382 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:15.102601 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.103788 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.105089 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.105867 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.106453 (+ 586us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.106519 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:15.106545 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 18:56:15.106585 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":99,"threads_started":1}
I20260811 18:56:15.107254 17281 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfc821bc82341e9a051a642d147c99d (DEFAULT_TABLE table=test-table [id=713e823706de4a4b97ed376729a2b384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:15.107353 17067 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfc821bc82341e9a051a642d147c99d (DEFAULT_TABLE table=test-table [id=713e823706de4a4b97ed376729a2b384]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:15.107594 17281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfc821bc82341e9a051a642d147c99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:15.107749 17067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfc821bc82341e9a051a642d147c99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:15.110278 17393 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Bootstrap starting.
I20260811 18:56:15.110359 17394 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Bootstrap starting.
I20260811 18:56:15.110993 17394 tablet_bootstrap.cc:654] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:15.110993 17393 tablet_bootstrap.cc:654] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:15.111509 17393 log.cc:824] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:15.111517 17394 log.cc:824] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:15.112231 17394 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: No bootstrap required, opened a new log
I20260811 18:56:15.112241 17393 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: No bootstrap required, opened a new log
I20260811 18:56:15.112290 17394 ts_tablet_manager.cc:1397] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:56:15.112319 17393 ts_tablet_manager.cc:1397] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:56:15.113688 17394 raft_consensus.cc:348] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.113822 17394 raft_consensus.cc:374] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:15.113845 17394 raft_consensus.cc:729] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa06f8e138a4db6ad4054f534cb66c7, State: Initialized, Role: FOLLOWER
I20260811 18:56:15.113968 17394 consensus_queue.cc:260] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.113929 17393 raft_consensus.cc:348] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.114123 17393 raft_consensus.cc:374] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:15.114172 17393 raft_consensus.cc:729] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b2264238603482fa5a84a793c04b4d8, State: Initialized, Role: FOLLOWER
I20260811 18:56:15.114269 17394 ts_tablet_manager.cc:1428] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 18:56:15.114300 17172 heartbeater.cc:503] Master 127.23.226.254:46595 was elected leader, sending a full tablet report...
I20260811 18:56:15.114307 17393 consensus_queue.cc:260] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.114614 17393 ts_tablet_manager.cc:1428] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:56:15.114634 17381 heartbeater.cc:503] Master 127.23.226.254:46595 was elected leader, sending a full tablet report...
W20260811 18:56:15.156514 17176 tablet.cc:2369] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:56:15.260214 16948 tablet.cc:2369] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:56:15.279739 17397 raft_consensus.cc:482] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:15.279915 17397 raft_consensus.cc:504] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.280330 17397 leader_election.cc:288] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), 4dc5a1f9290f401c821b4dec9352d3fb (127.23.226.193:34861)
I20260811 18:56:15.283686 17391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.280717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:55977 (local address 127.23.226.195:37475)
0811 18:56:15.280785 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.280788 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.280802 (+ 14us) server_negotiation.cc:407] Connection header received
0811 18:56:15.280837 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.280838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.280850 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.280958 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:15.281244 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.281779 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.282945 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.283324 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.283383 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.283414 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:15.283564 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 18:56:15.283611 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:56:15.283748 16959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.280898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:47231 (local address 127.23.226.193:34861)
0811 18:56:15.280951 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.280953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.281040 (+ 87us) server_negotiation.cc:407] Connection header received
0811 18:56:15.281088 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.281089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.281101 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.281167 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:15.281359 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.281858 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.282895 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.283337 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.283426 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.283435 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:15.283617 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 18:56:15.283680 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:56:15.283723 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.280609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37475 (local address 127.23.226.194:55977)
0811 18:56:15.280674 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:15.280687 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:15.280737 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:15.280983 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:15.280984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:15.280986 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:15.281140 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.281143 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.281870 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.281871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.282825 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.282828 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.283403 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.283404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.283492 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.283495 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:56:15.283538 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 18:56:15.283590 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":44}
I20260811 18:56:15.283742 17400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.280771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34861 (local address 127.23.226.194:47231)
0811 18:56:15.280961 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:15.280973 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:15.281036 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:15.281187 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:15.281204 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:15.281206 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:15.281286 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.281288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.281948 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.281949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.282800 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:15.282803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.283452 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.283457 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:15.283515 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.283519 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:56:15.283597 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 18:56:15.283633 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":3,"thread_start_us":111,"threads_started":1}
I20260811 18:56:15.284108 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfc821bc82341e9a051a642d147c99d" candidate_uuid: "afa06f8e138a4db6ad4054f534cb66c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b2264238603482fa5a84a793c04b4d8" is_pre_election: true
I20260811 18:56:15.284267 17316 raft_consensus.cc:2454] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afa06f8e138a4db6ad4054f534cb66c7 in term 0.
I20260811 18:56:15.284549 16992 leader_election.cc:302] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b2264238603482fa5a84a793c04b4d8, afa06f8e138a4db6ad4054f534cb66c7; no voters:
I20260811 18:56:15.284571 16882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfc821bc82341e9a051a642d147c99d" candidate_uuid: "afa06f8e138a4db6ad4054f534cb66c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" is_pre_election: true
I20260811 18:56:15.284747 16882 raft_consensus.cc:2454] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afa06f8e138a4db6ad4054f534cb66c7 in term 0.
I20260811 18:56:15.284729 17397 raft_consensus.cc:2781] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:56:15.284796 17397 raft_consensus.cc:482] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:56:15.284834 17397 raft_consensus.cc:3037] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:15.285665 17397 raft_consensus.cc:504] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.285818 17397 leader_election.cc:288] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [CANDIDATE]: Term 1 election: Requested vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), 4dc5a1f9290f401c821b4dec9352d3fb (127.23.226.193:34861)
I20260811 18:56:15.286006 16882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfc821bc82341e9a051a642d147c99d" candidate_uuid: "afa06f8e138a4db6ad4054f534cb66c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dc5a1f9290f401c821b4dec9352d3fb"
I20260811 18:56:15.286019 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfc821bc82341e9a051a642d147c99d" candidate_uuid: "afa06f8e138a4db6ad4054f534cb66c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b2264238603482fa5a84a793c04b4d8"
I20260811 18:56:15.286088 17316 raft_consensus.cc:3037] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:15.286111 16882 raft_consensus.cc:3037] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:15.286887 16882 raft_consensus.cc:2454] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afa06f8e138a4db6ad4054f534cb66c7 in term 1.
I20260811 18:56:15.287045 17316 raft_consensus.cc:2454] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afa06f8e138a4db6ad4054f534cb66c7 in term 1.
I20260811 18:56:15.287122 16992 leader_election.cc:302] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dc5a1f9290f401c821b4dec9352d3fb, afa06f8e138a4db6ad4054f534cb66c7; no voters:
I20260811 18:56:15.287246 17397 raft_consensus.cc:2781] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:15.287402 17397 raft_consensus.cc:686] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 1 LEADER]: Becoming Leader. State: Replica: afa06f8e138a4db6ad4054f534cb66c7, State: Running, Role: LEADER
I20260811 18:56:15.287510 17397 consensus_queue.cc:237] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:15.288471 16657 catalog_manager.cc:5495] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194). New cstate: current_term: 1 leader_uuid: "afa06f8e138a4db6ad4054f534cb66c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } health_report { overall_health: UNKNOWN } } }
W20260811 18:56:15.315407 17382 tablet.cc:2369] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:56:15.339402 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.336742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60478 (local address 127.23.226.194:33821)
0811 18:56:15.336800 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:15.336802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:15.336813 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:56:15.336901 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:15.336902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:15.336927 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:15.337004 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:56:15.337166 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.337640 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.338523 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:15.338733 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:15.338813 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:15.338990 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:56:15.339095 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:56:15.339216 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:15.339235 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 18:56:15.339258 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 18:56:15.341650 16882 raft_consensus.cc:1261] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Refusing update from remote peer afa06f8e138a4db6ad4054f534cb66c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:15.341650 17316 raft_consensus.cc:1261] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 1 FOLLOWER]: Refusing update from remote peer afa06f8e138a4db6ad4054f534cb66c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:15.342067 17397 consensus_queue.cc:1035] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:15.342301 17401 consensus_queue.cc:1035] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:15.346771 16657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:15.346876 16657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:15.347780 16657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Sending DeleteTablet for 3 replicas of tablet 2cfc821bc82341e9a051a642d147c99d
I20260811 18:56:15.348114 17067 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfc821bc82341e9a051a642d147c99d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:15 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:60462
I20260811 18:56:15.348233 17281 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfc821bc82341e9a051a642d147c99d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:15 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:59898
I20260811 18:56:15.348333 17419 tablet_replica.cc:330] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: stopping tablet replica
I20260811 18:56:15.348431 17419 raft_consensus.cc:2229] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:56:15.348438 16852 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfc821bc82341e9a051a642d147c99d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:15 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:38028
I20260811 18:56:15.348532 17419 raft_consensus.cc:2258] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:15.348752 17420 tablet_replica.cc:330] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: stopping tablet replica
I20260811 18:56:15.348819 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 16721
I20260811 18:56:15.348884 17420 raft_consensus.cc:2229] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:15.348984 17420 raft_consensus.cc:2258] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:15.354759 17420 ts_tablet_manager.cc:1905] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:15.356392 17420 ts_tablet_manager.cc:1918] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:15.356499 17420 log.cc:1196] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/2cfc821bc82341e9a051a642d147c99d
I20260811 18:56:15.356789 17420 ts_tablet_manager.cc:1939] T 2cfc821bc82341e9a051a642d147c99d P 8b2264238603482fa5a84a793c04b4d8: Deleting consensus metadata
I20260811 18:56:15.357235 16642 catalog_manager.cc:4841] TS 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475): tablet 2cfc821bc82341e9a051a642d147c99d (table test-table [id=713e823706de4a4b97ed376729a2b384]) successfully deleted
I20260811 18:56:15.367364 17419 ts_tablet_manager.cc:1905] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:15.369351 17419 ts_tablet_manager.cc:1918] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:15.369448 17419 log.cc:1196] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/2cfc821bc82341e9a051a642d147c99d
I20260811 18:56:15.369745 17419 ts_tablet_manager.cc:1939] T 2cfc821bc82341e9a051a642d147c99d P afa06f8e138a4db6ad4054f534cb66c7: Deleting consensus metadata
I20260811 18:56:15.370299 16638 catalog_manager.cc:4841] TS afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821): tablet 2cfc821bc82341e9a051a642d147c99d (table test-table [id=713e823706de4a4b97ed376729a2b384]) successfully deleted
W20260811 18:56:15.372843 16642 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:34861 (error 108)
I20260811 18:56:15.373184 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 16955
I20260811 18:56:15.374006 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:15.373290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34861 (local address 127.0.0.1:38040)
0811 18:56:15.373906 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:15.373965 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:34861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":586}
W20260811 18:56:15.374253 16642 catalog_manager.cc:4584] TS 4dc5a1f9290f401c821b4dec9352d3fb (127.23.226.193:34861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2cfc821bc82341e9a051a642d147c99d: Network error: Client connection negotiation failed: client connection to 127.23.226.193:34861: connect: Connection refused (error 111)
I20260811 18:56:15.385344 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 17179
I20260811 18:56:15.396713 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 16617
I20260811 18:56:35.408658 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46595
--webserver_interface=127.23.226.254
--webserver_port=37589
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:46595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:35.498543 17426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:35.498747 17426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:35.498770 17426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:35.499852 17426 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 18:56:35.499884 17426 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 18:56:35.499897 17426 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 18:56:35.499909 17426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:35.499922 17426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:35.499936 17426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:35.499948 17426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:35.499974 17426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:35.501385 17426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:46595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=37589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:35.501574 17426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:35.501747 17426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:35.506940 17444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:35.506986 17439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:35.506956 17434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:35.507107 17426 server_base.cc:1034] running on GCE node
I20260811 18:56:35.507886 17426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:35.508183 17426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:35.509363 17426 hybrid_clock.cc:648] HybridClock initialized: now 1786474595509350 us; error 31 us; skew 500 ppm
Aug 11 18:56:35 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474595, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:35.512121 17426 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:56:35.512601 17426 webserver.cc:460] Webserver started at http://127.23.226.254:37589/ using document root <none> and password file <none>
I20260811 18:56:35.512821 17426 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:35.512864 17426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:35.514204 17426 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:35.514956 17455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:35.515164 17426 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 18:56:35.515254 17426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "6c13883e957341599e3da58be323192a"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "d0306a4aa20005dd997021dbbfcf53cc"
server_key_iv: "daad93d1f9a9dc030c74bcd5e056af91"
server_key_version: "encryptionkey@0"
I20260811 18:56:35.515575 17426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:35.536268 17426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:35.538883 17426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:35.539018 17426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:35.543138 17426 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:46595
I20260811 18:56:35.543175 17527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:46595 every 8 connection(s)
I20260811 18:56:35.543758 17426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:35.545218 17528 sys_catalog.cc:263] Verifying existing consensus state
I20260811 18:56:35.545526 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 17426
I20260811 18:56:35.545789 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:34861
--local_ip_for_outbound_sockets=127.23.226.193
--tserver_master_addrs=127.23.226.254:46595
--webserver_port=37457
--webserver_interface=127.23.226.193
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:56:35.546087 17528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Bootstrap starting.
I20260811 18:56:35.556726 17528 log.cc:824] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:35.559142 17528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:56:35.559466 17528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Bootstrap complete.
I20260811 18:56:35.562026 17528 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:56:35.562285 17528 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c13883e957341599e3da58be323192a, State: Initialized, Role: FOLLOWER
I20260811 18:56:35.562512 17528 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:56:35.562623 17528 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:35.562680 17528 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:35.562731 17528 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 2 FOLLOWER]: Advancing to term 3
I20260811 18:56:35.563745 17528 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:56:35.563869 17528 leader_election.cc:302] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c13883e957341599e3da58be323192a; no voters:
I20260811 18:56:35.564064 17528 leader_election.cc:288] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 18:56:35.564136 17533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 3 FOLLOWER]: Leader election won for term 3
I20260811 18:56:35.564332 17533 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [term 3 LEADER]: Becoming Leader. State: Replica: 6c13883e957341599e3da58be323192a, State: Running, Role: LEADER
I20260811 18:56:35.564363 17528 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:35.564445 17533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } }
I20260811 18:56:35.564749 17533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c13883e957341599e3da58be323192a. Latest consensus state: current_term: 3 leader_uuid: "6c13883e957341599e3da58be323192a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } } }
I20260811 18:56:35.564819 17533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:35.564956 17534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6c13883e957341599e3da58be323192a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c13883e957341599e3da58be323192a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46595 } } }
I20260811 18:56:35.565011 17534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:35.565126 17544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:35.565923 17544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:56:35.566030 17544 catalog_manager.cc:1259] Loaded cluster ID: a308b14cfdcd4c80a04221b76a35c9ad
I20260811 18:56:35.566264 17544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:56:35.567595 17544 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:35.567778 17544 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Loaded TSK: 0
I20260811 18:56:35.567828 17544 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6c13883e957341599e3da58be323192a: Loaded TSK: 1
F20260811 18:56:35.568058 17544 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f65748b39ad google::LogMessage::Fail() at ??:0
@ 0x7f65748b688a google::LogMessage::SendToLog() at ??:0
@ 0x7f65748b34de google::LogMessage::Flush() at ??:0
@ 0x7f65748b4a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6577020104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f657701dd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f657c80d1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f657c80d48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f657c80d594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f657c7d3c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f657c7ddad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f65767810d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6576776954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f65775da6db start_thread at ??:0
@ 0x7f65733b161f clone at ??:0
W20260811 18:56:35.655166 17531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:35.655396 17531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:35.655423 17531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:35.656575 17531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:35.656618 17531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:35.656644 17531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:56:35.658107 17531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:34861
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=37457
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:35.658361 17531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:35.658660 17531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:35.663882 17595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:35.663961 17594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:35.663880 17598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:35.664196 17531 server_base.cc:1034] running on GCE node
I20260811 18:56:35.664407 17531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:35.664726 17531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:35.665895 17531 hybrid_clock.cc:648] HybridClock initialized: now 1786474595665874 us; error 38 us; skew 500 ppm
Aug 11 18:56:35 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474595, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:35.668900 17531 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:56:35.669473 17531 webserver.cc:460] Webserver started at http://127.23.226.193:37457/ using document root <none> and password file <none>
I20260811 18:56:35.669814 17531 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:35.669899 17531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:35.671836 17531 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:35.672698 17609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:35.672951 17531 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:35.673079 17531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "4dc5a1f9290f401c821b4dec9352d3fb"
format_stamp: "Formatted at 2026-08-11 18:55:53 on dist-test-slave-68xk"
server_key: "15608b350263a222608b9b791ad87c17"
server_key_iv: "b2ac74500fc763f5153ebe45a7e1b22f"
server_key_version: "encryptionkey@0"
I20260811 18:56:35.673470 17531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:35.703627 17531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:35.706480 17531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:35.706683 17531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:35.706975 17531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:35.707604 17621 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 18:56:35.709653 17531 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 18:56:35.709736 17531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 18:56:35.709791 17531 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 18:56:35.710562 17531 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 18:56:35.710623 17531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:35.710697 17621 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Bootstrap starting.
I20260811 18:56:35.719341 17531 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:34861
I20260811 18:56:35.719409 17779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:34861 every 8 connection(s)
I20260811 18:56:35.719905 17531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:56:35.723364 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 17531
I20260811 18:56:35.723717 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:33821
--local_ip_for_outbound_sockets=127.23.226.194
--tserver_master_addrs=127.23.226.254:46595
--webserver_port=46535
--webserver_interface=127.23.226.194
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:56:35.724380 17621 log.cc:824] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:35.727514 17621 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 18:56:35.727872 17621 tablet_bootstrap.cc:492] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Bootstrap complete.
I20260811 18:56:35.729485 17621 ts_tablet_manager.cc:1397] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.011s
I20260811 18:56:35.731629 17621 raft_consensus.cc:348] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:35.732084 17621 raft_consensus.cc:729] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc5a1f9290f401c821b4dec9352d3fb, State: Initialized, Role: FOLLOWER
I20260811 18:56:35.732280 17621 consensus_queue.cc:260] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:35.732626 17621 ts_tablet_manager.cc:1428] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
W20260811 18:56:35.776185 17785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:56:35.720772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:50475)
0811 18:56:35.721021 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.721087 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:35.721948 (+ 861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:35.775948 (+ 54000us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":104,"threads_started":1}
W20260811 18:56:35.776459 17782 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:46595 (0 consecutive failures): Network error: Failed to ping master at 127.23.226.254:46595: Client connection negotiation failed: client connection to 127.23.226.254:46595: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 18:56:35.776883 17785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:35.776728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:57811)
0811 18:56:35.776774 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.776849 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 18:56:35.777431 17785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:35.777305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:55049)
0811 18:56:35.777351 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.777377 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 18:56:35.777544 17782 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 18:56:35.818382 17790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:35.818691 17790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:35.818734 17790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:35.820353 17790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:35.820505 17790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:35.820557 17790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:56:35.822249 17790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:33821
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=46535
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:35.822570 17790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:35.822818 17790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:35.827999 17799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:35.828011 17803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:35.828347 17790 server_base.cc:1034] running on GCE node
W20260811 18:56:35.828018 17798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:35.828660 17790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:35.828913 17790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:35.830142 17790 hybrid_clock.cc:648] HybridClock initialized: now 1786474595830134 us; error 56 us; skew 500 ppm
Aug 11 18:56:35 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474595, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:35.832854 17790 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:56:35.833292 17790 webserver.cc:460] Webserver started at http://127.23.226.194:46535/ using document root <none> and password file <none>
I20260811 18:56:35.833480 17790 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:35.833523 17790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:35.834981 17790 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:35.835647 17812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:35.835906 17790 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:35.835990 17790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "afa06f8e138a4db6ad4054f534cb66c7"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "d16f78a1e164b771e395ef39aeb240c2"
server_key_iv: "e6748faafbca6974774089169f985e04"
server_key_version: "encryptionkey@0"
I20260811 18:56:35.836354 17790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:35.847426 17790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:35.849306 17790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:35.849418 17790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:35.849598 17790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:35.849854 17790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:35.849885 17790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:35.849906 17790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:35.849920 17790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:35.856276 17790 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:33821
I20260811 18:56:35.856329 17988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:33821 every 8 connection(s)
I20260811 18:56:35.856663 17790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:56:35.857736 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:35.857349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:51309)
0811 18:56:35.857503 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.857576 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
W20260811 18:56:35.858177 17989 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:46595 (0 consecutive failures): Network error: Failed to ping master at 127.23.226.254:46595: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
I20260811 18:56:35.858534 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:35.858399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:38959)
0811 18:56:35.858480 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.858518 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 18:56:35.858853 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:35.858786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:36459)
0811 18:56:35.858821 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.858840 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 18:56:35.858980 17989 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:56:35.861788 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 17790
I20260811 18:56:35.862111 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:37475
--local_ip_for_outbound_sockets=127.23.226.195
--tserver_master_addrs=127.23.226.254:46595
--webserver_port=45257
--webserver_interface=127.23.226.195
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:35.949133 17996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:35.949383 17996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:35.949424 17996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:35.950608 17996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:35.950687 17996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:35.950734 17996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:56:35.952277 17996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:37475
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=45257
--tserver_master_addrs=127.23.226.254:46595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:35.952561 17996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:35.952843 17996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:35.958401 18009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:35.958415 18005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:35.958442 18004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:35.958671 17996 server_base.cc:1034] running on GCE node
I20260811 18:56:35.958915 17996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:35.959175 17996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:35.960361 17996 hybrid_clock.cc:648] HybridClock initialized: now 1786474595960351 us; error 33 us; skew 500 ppm
Aug 11 18:56:35 dist-test-slave-68xk krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474595, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:35.963099 17996 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:56:35.963505 17996 webserver.cc:460] Webserver started at http://127.23.226.195:45257/ using document root <none> and password file <none>
I20260811 18:56:35.963711 17996 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:35.963757 17996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:35.965070 17996 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:35.965685 18024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:35.965894 17996 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:35.965986 17996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "8b2264238603482fa5a84a793c04b4d8"
format_stamp: "Formatted at 2026-08-11 18:55:54 on dist-test-slave-68xk"
server_key: "432b64392ce44b60a4ef41a8bf952701"
server_key_iv: "f00955c6f632151d487ce525d8f55d35"
server_key_version: "encryptionkey@0"
I20260811 18:56:35.966315 17996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:35.979426 17996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:35.981805 17996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:35.981923 17996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:35.982120 17996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:35.982524 17996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:35.982565 17996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:35.982589 17996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:35.982620 17996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:35.989307 17996 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:37475
I20260811 18:56:35.989370 18200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:37475 every 8 connection(s)
I20260811 18:56:35.989730 17996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:56:35.990936 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:35.990536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:47021)
0811 18:56:35.990704 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.990779 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
W20260811 18:56:35.991413 18202 heartbeater.cc:644] Failed to heartbeat to 127.23.226.254:46595 (0 consecutive failures): Network error: Failed to ping master at 127.23.226.254:46595: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
I20260811 18:56:35.991784 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:35.991663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:51789)
0811 18:56:35.991731 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.991765 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 18:56:35.992121 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:35.992030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:41809)
0811 18:56:35.992078 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:35.992101 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 18:56:35.992332 18202 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 18:56:35.998246 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 17996
I20260811 18:56:36.778223 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:36.777954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:44505)
0811 18:56:36.778092 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:36.778137 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260811 18:56:36.859566 18209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:36.859337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:58767)
0811 18:56:36.859479 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:36.859518 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260811 18:56:36.992995 18211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:36.992749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:55911)
0811 18:56:36.992894 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:36.992934 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
I20260811 18:56:37.529045 18212 raft_consensus.cc:482] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:37.529225 18212 raft_consensus.cc:504] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:37.529704 18212 leader_election.cc:288] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
Aug 11 18:56:37 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474595, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.194@KRBTEST.COM
Aug 11 18:56:37 dist-test-slave-68xk krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474595, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.195@KRBTEST.COM
I20260811 18:56:37.541859 18221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:37.530112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:54677 (local address 127.23.226.194:33821)
0811 18:56:37.530262 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:37.530280 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:37.530300 (+ 20us) server_negotiation.cc:407] Connection header received
0811 18:56:37.530805 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:37.530807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:37.530862 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:37.531025 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:37.531851 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:37.532774 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:37.533874 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:37.534317 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:37.534484 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:37.537068 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:37.537072 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:37.537072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:37.537084 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:37.539423 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:37.540146 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:37.540150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:37.540150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:37.540293 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:37.540704 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:37.540706 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:37.540706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:37.541068 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:37.541178 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:37.541584 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 18:56:37.541733 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260811 18:56:37.541859 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:37.529880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37475 (local address 127.23.226.193:48317)
0811 18:56:37.530035 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:37.530047 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:37.530128 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:37.531039 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:37.531042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:37.531523 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:37.531701 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:37.531707 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:37.532919 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:37.532920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:37.533768 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:37.533770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:37.534448 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:37.534449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:37.534590 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:37.535324 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:37.535334 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:37.537365 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:37.539840 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:37.539841 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:37.539841 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:37.540187 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:37.540477 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:37.540478 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:37.540478 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:37.540585 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:37.541207 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:37.541208 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:37.541360 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 18:56:37.541487 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 18:56:37.541694 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":9,"thread_start_us":86,"threads_started":1}
I20260811 18:56:37.541879 18220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:37.530004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:48317 (local address 127.23.226.195:37475)
0811 18:56:37.530186 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:37.530199 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:37.530232 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:56:37.530783 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:37.530786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:37.530834 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:37.531004 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:37.531831 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:37.532790 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:37.533866 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:37.534310 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:37.534477 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:37.537529 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:37.537533 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:37.537533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:37.537544 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:37.539744 (+ 2200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:37.540266 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:37.540269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:37.540269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:37.540387 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:37.540704 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:37.540706 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:37.540706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:37.541129 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:37.541213 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:37.541579 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 18:56:37.541733 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":55,"threads_started":1}
I20260811 18:56:37.541917 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:37.529892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:33821 (local address 127.23.226.193:54677)
0811 18:56:37.530047 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:37.530059 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:37.530139 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:37.531039 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:37.531042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:37.531497 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:37.531701 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:37.531707 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:37.532901 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:37.532902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:37.533766 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:37.533769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:37.534456 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:37.534458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:37.534595 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:37.535392 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:37.535397 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:37.536918 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:37.539528 (+ 2610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:37.539534 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:37.539550 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:37.539997 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:37.540401 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:37.540402 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:37.540402 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:37.540585 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:37.541162 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:37.541191 (+ 29us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:37.541360 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 18:56:37.541487 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 18:56:37.541753 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":216,"thread_start_us":76,"threads_started":1}
W20260811 18:56:37.543331 17611 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
W20260811 18:56:37.543427 17614 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
I20260811 18:56:37.543495 17614 leader_election.cc:302] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dc5a1f9290f401c821b4dec9352d3fb; no voters: 8b2264238603482fa5a84a793c04b4d8, afa06f8e138a4db6ad4054f534cb66c7
I20260811 18:56:37.543601 18212 raft_consensus.cc:2726] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:56:37.778846 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:37.778701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:36513)
0811 18:56:37.778758 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:37.778802 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 18:56:37.860344 18222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:37.860093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:37199)
0811 18:56:37.860240 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:37.860292 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260811 18:56:37.993922 18223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:37.993601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:36591)
0811 18:56:37.993833 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:37.993876 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":151,"threads_started":1}
I20260811 18:56:38.779619 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:38.779375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:55011)
0811 18:56:38.779513 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:38.779569 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":67,"threads_started":1}
I20260811 18:56:38.861074 18227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:38.860840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:51449)
0811 18:56:38.860989 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:38.861030 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260811 18:56:38.994750 18228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:38.994500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:36101)
0811 18:56:38.994650 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:38.994700 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":64,"threads_started":1}
I20260811 18:56:39.044934 18229 raft_consensus.cc:482] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:39.045071 18229 raft_consensus.cc:504] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:39.045321 18229 leader_election.cc:288] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
W20260811 18:56:39.045871 17611 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
W20260811 18:56:39.045966 17614 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
I20260811 18:56:39.046068 17614 leader_election.cc:302] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dc5a1f9290f401c821b4dec9352d3fb; no voters: 8b2264238603482fa5a84a793c04b4d8, afa06f8e138a4db6ad4054f534cb66c7
I20260811 18:56:39.046180 18229 raft_consensus.cc:2726] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:56:39.780512 18230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:39.780235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:41127)
0811 18:56:39.780406 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:39.780460 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
I20260811 18:56:39.861979 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:39.861725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:44007)
0811 18:56:39.861881 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:39.861932 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":71,"threads_started":1}
I20260811 18:56:39.995574 18235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:39.995327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:44255)
0811 18:56:39.995480 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:39.995524 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":66,"threads_started":1}
I20260811 18:56:40.781389 18236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:40.781154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:46193)
0811 18:56:40.781300 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:40.781340 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260811 18:56:40.862902 18238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:40.862629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:50087)
0811 18:56:40.862813 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:40.862857 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":86,"threads_started":1}
I20260811 18:56:40.996464 18239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:40.996198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:54881)
0811 18:56:40.996361 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:40.996406 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":67,"threads_started":1}
I20260811 18:56:41.296661 18240 raft_consensus.cc:482] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:41.296767 18240 raft_consensus.cc:504] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:41.296962 18240 leader_election.cc:288] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
W20260811 18:56:41.297317 17614 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
W20260811 18:56:41.297407 17611 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
I20260811 18:56:41.297495 17611 leader_election.cc:302] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dc5a1f9290f401c821b4dec9352d3fb; no voters: 8b2264238603482fa5a84a793c04b4d8, afa06f8e138a4db6ad4054f534cb66c7
I20260811 18:56:41.297585 18240 raft_consensus.cc:2726] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:56:41.782222 18243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:41.781950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:53427)
0811 18:56:41.782089 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:41.782131 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260811 18:56:41.863677 18245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:41.863410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:59719)
0811 18:56:41.863581 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:41.863627 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":69,"threads_started":1}
I20260811 18:56:41.997336 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:41.997060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:44455)
0811 18:56:41.997238 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:41.997283 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
I20260811 18:56:42.783023 18247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:42.782797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:46915)
0811 18:56:42.782931 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:42.782972 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260811 18:56:42.864496 18248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:42.864251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:60153)
0811 18:56:42.864410 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:42.864451 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":89,"threads_started":1}
I20260811 18:56:42.998196 18249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:42.997961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:54331)
0811 18:56:42.998113 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:42.998147 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260811 18:56:43.783767 18250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:43.783514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:57027)
0811 18:56:43.783672 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:43.783717 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":69,"threads_started":1}
I20260811 18:56:43.865268 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:43.864977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:34145)
0811 18:56:43.865174 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:43.865216 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":98,"threads_started":1}
I20260811 18:56:43.999085 18255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:43.998812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:59847)
0811 18:56:43.998988 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:43.999032 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":89,"threads_started":1}
I20260811 18:56:44.784675 18257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:44.784447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:51055)
0811 18:56:44.784580 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:44.784621 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260811 18:56:44.866135 18258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:44.865858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:50587)
0811 18:56:44.866031 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:44.866078 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":78,"threads_started":1}
I20260811 18:56:44.999877 18259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:44.999635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:59043)
0811 18:56:44.999788 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:44.999829 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260811 18:56:45.456789 18261 raft_consensus.cc:482] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:45.456895 18261 raft_consensus.cc:504] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:45.457078 18261 leader_election.cc:288] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
W20260811 18:56:45.457513 17614 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
W20260811 18:56:45.457604 17611 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
I20260811 18:56:45.457715 17611 leader_election.cc:302] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dc5a1f9290f401c821b4dec9352d3fb; no voters: 8b2264238603482fa5a84a793c04b4d8, afa06f8e138a4db6ad4054f534cb66c7
I20260811 18:56:45.457793 18261 raft_consensus.cc:2726] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:56:45.785473 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:45.785222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:34581)
0811 18:56:45.785380 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:45.785422 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":70,"threads_started":1}
I20260811 18:56:45.866910 18265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:45.866683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:37659)
0811 18:56:45.866808 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:45.866860 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":64,"threads_started":1}
I20260811 18:56:46.000663 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:46.000417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:54567)
0811 18:56:46.000574 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:46.000615 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":68,"threads_started":1}
I20260811 18:56:46.786366 18269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:46.786085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:47797)
0811 18:56:46.786262 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:46.786314 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":109,"threads_started":1}
I20260811 18:56:46.867602 18270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:46.867391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:39909)
0811 18:56:46.867519 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:46.867556 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260811 18:56:47.001394 18272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:47.001175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:41035)
0811 18:56:47.001312 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:47.001348 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260811 18:56:47.787335 18273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:47.787032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:35327)
0811 18:56:47.787236 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:47.787286 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":128,"threads_started":1}
I20260811 18:56:47.868393 18274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:47.868131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:40679)
0811 18:56:47.868274 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:47.868337 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260811 18:56:48.002264 18275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:48.001996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:38569)
0811 18:56:48.002177 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:48.002216 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":65,"threads_started":1}
I20260811 18:56:48.788074 18276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:48.787859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:44407)
0811 18:56:48.787984 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:48.788022 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260811 18:56:48.869292 18277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:48.868980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:52617)
0811 18:56:48.869201 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:48.869242 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":148,"threads_started":1}
I20260811 18:56:49.003104 18279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:49.002862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:54191)
0811 18:56:49.003022 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:49.003059 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":99,"threads_started":1}
I20260811 18:56:49.788815 18281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:49.788599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:36355)
0811 18:56:49.788727 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:49.788765 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260811 18:56:49.870054 18282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:49.869819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:58963)
0811 18:56:49.869963 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:49.870004 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":67,"threads_started":1}
I20260811 18:56:50.004036 18283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:50.003726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:35875)
0811 18:56:50.003928 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:50.003984 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":119,"threads_started":1}
I20260811 18:56:50.183882 18285 raft_consensus.cc:482] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:50.183987 18285 raft_consensus.cc:504] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b2264238603482fa5a84a793c04b4d8" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37475 } } peers { permanent_uuid: "afa06f8e138a4db6ad4054f534cb66c7" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 33821 } } peers { permanent_uuid: "4dc5a1f9290f401c821b4dec9352d3fb" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34861 } }
I20260811 18:56:50.184203 18285 leader_election.cc:288] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475), afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821)
W20260811 18:56:50.184602 17614 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b2264238603482fa5a84a793c04b4d8 (127.23.226.195:37475): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
W20260811 18:56:50.184746 17611 leader_election.cc:341] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer afa06f8e138a4db6ad4054f534cb66c7 (127.23.226.194:33821): Not found: Tablet not found: 2cfc821bc82341e9a051a642d147c99d
I20260811 18:56:50.184809 17611 leader_election.cc:302] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dc5a1f9290f401c821b4dec9352d3fb; no voters: 8b2264238603482fa5a84a793c04b4d8, afa06f8e138a4db6ad4054f534cb66c7
I20260811 18:56:50.184894 18285 raft_consensus.cc:2726] T 2cfc821bc82341e9a051a642d147c99d P 4dc5a1f9290f401c821b4dec9352d3fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 18:56:50.789641 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:50.789415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.193:47627)
0811 18:56:50.789555 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:50.789592 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260811 18:56:50.870887 18287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:50.870677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.194:57575)
0811 18:56:50.870803 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:50.870842 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
I20260811 18:56:51.005288 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:51.004973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46595 (local address 127.23.226.195:50071)
0811 18:56:51.005145 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:51.005200 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.254:46595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":81,"threads_started":1}
I20260811 18:56:51.010066 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 17531
I20260811 18:56:51.023772 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 17790
I20260811 18:56:51.031493 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 17996
2026-08-11T18:56:51Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59745 ms)
[----------] 30 tests from SecurityITest (247219 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:56:51 dist-test-slave-68xk krb5kdc[18292](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:56:51 dist-test-slave-68xk krb5kdc[18292](info): set up 2 sockets
Aug 11 18:56:51 dist-test-slave-68xk krb5kdc[18292](info): commencing operation
krb5kdc: starting...
W20260811 18:56:53.238148 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:56:53 dist-test-slave-68xk krb5kdc[18292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:56:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:56:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:56:53.373960 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41167
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:41167
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:53.466055 18309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:53.466333 18309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:53.466380 18309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:53.467598 18309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:53.467676 18309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:53.467700 18309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:53.467720 18309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:53.467751 18309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:53.469296 18309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:41167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:41167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:53.469571 18309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:53.469827 18309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:53.475325 18320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:53.475342 18318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:53.475672 18309 server_base.cc:1034] running on GCE node
W20260811 18:56:53.475360 18317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:53.476032 18309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:53.476348 18309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:53.477527 18309 hybrid_clock.cc:648] HybridClock initialized: now 1786474613477524 us; error 42 us; skew 500 ppm
Aug 11 18:56:53 dist-test-slave-68xk krb5kdc[18292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474613, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:53.480415 18309 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:56:53.480991 18309 webserver.cc:460] Webserver started at http://127.23.226.254:36257/ using document root <none> and password file <none>
I20260811 18:56:53.481285 18309 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:53.481369 18309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:53.481539 18309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:53.482848 18309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "4bf02e08191f409a8cf9ea0b65935a7b"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "8fbbd31330b3926875d0f52dd1c1375a"
server_key_iv: "bded394d233477c0b3ca84d9e61d527d"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.483266 18309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "4bf02e08191f409a8cf9ea0b65935a7b"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "8fbbd31330b3926875d0f52dd1c1375a"
server_key_iv: "bded394d233477c0b3ca84d9e61d527d"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.484834 18309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:56:53.485754 18331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:53.486024 18309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:53.486143 18309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "4bf02e08191f409a8cf9ea0b65935a7b"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "8fbbd31330b3926875d0f52dd1c1375a"
server_key_iv: "bded394d233477c0b3ca84d9e61d527d"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.486229 18309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:53.496335 18309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:53.498886 18309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:53.499094 18309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:53.503712 18309 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:41167
I20260811 18:56:53.503769 18397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:41167 every 8 connection(s)
I20260811 18:56:53.504168 18309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:53.505165 18398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:53.507818 18398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b: Bootstrap starting.
I20260811 18:56:53.508426 18398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:53.508747 18398 log.cc:824] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:53.509548 18398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b: No bootstrap required, opened a new log
I20260811 18:56:53.510500 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 18309
I20260811 18:56:53.510622 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:56:53.510814 24459 external_mini_cluster.cc:1428] Setting key a591f9391a99b8425ffadf07fbeb1d70
I20260811 18:56:53.511922 18398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf02e08191f409a8cf9ea0b65935a7b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41167 } }
I20260811 18:56:53.512108 18398 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:53.512154 18398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bf02e08191f409a8cf9ea0b65935a7b, State: Initialized, Role: FOLLOWER
I20260811 18:56:53.512300 18398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf02e08191f409a8cf9ea0b65935a7b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41167 } }
I20260811 18:56:53.512392 18398 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:53.512434 18398 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:53.512488 18398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:53.513588 18398 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf02e08191f409a8cf9ea0b65935a7b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41167 } }
I20260811 18:56:53.513720 18398 leader_election.cc:302] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bf02e08191f409a8cf9ea0b65935a7b; no voters:
I20260811 18:56:53.513895 18398 leader_election.cc:288] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:56:53.513945 18405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:53.514163 18405 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [term 1 LEADER]: Becoming Leader. State: Replica: 4bf02e08191f409a8cf9ea0b65935a7b, State: Running, Role: LEADER
I20260811 18:56:53.514169 18398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:53.514340 18405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf02e08191f409a8cf9ea0b65935a7b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41167 } }
I20260811 18:56:53.514778 18407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bf02e08191f409a8cf9ea0b65935a7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf02e08191f409a8cf9ea0b65935a7b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41167 } } }
I20260811 18:56:53.514860 18407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:53.515103 18409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bf02e08191f409a8cf9ea0b65935a7b. Latest consensus state: current_term: 1 leader_uuid: "4bf02e08191f409a8cf9ea0b65935a7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bf02e08191f409a8cf9ea0b65935a7b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 41167 } } }
I20260811 18:56:53.515455 18409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:53.515604 18424 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:53.516119 18424 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:56:53.517864 18424 catalog_manager.cc:1347] Generated new cluster ID: 2e5d6b288b654e689a35e0436b393e9a
I20260811 18:56:53.517918 18424 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:56:53 dist-test-slave-68xk krb5kdc[18292](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:53.523439 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:53.511400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58650 (local address 127.23.226.254:41167)
0811 18:56:53.511691 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:53.511700 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:53.511727 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:56:53.511881 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:53.511887 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:53.511930 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:53.512045 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:53.512894 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.514034 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.515203 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.515824 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.515934 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:53.518956 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:53.518960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:53.518961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:53.518974 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:53.521113 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:53.521548 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:53.521551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:53.521552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:53.521695 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:53.521914 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:53.521915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:53.521916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:53.522226 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:53.522384 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:53.522871 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 18:56:53.523018 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":178,"threads_started":1}
I20260811 18:56:53.528168 18424 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:56:53.528728 18424 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:53.532733 18424 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b: Generated new TSK 0
I20260811 18:56:53.532924 18424 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:56:53.570111 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41167
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:53.658077 18441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:53.658321 18441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:53.658365 18441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:53.659555 18441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:53.659622 18441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:53.659665 18441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:56:53.661119 18441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:53.661408 18441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:53.661655 18441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:53.667086 18453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:53.667099 18451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:53.667104 18447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:53.667351 18441 server_base.cc:1034] running on GCE node
I20260811 18:56:53.667548 18441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:53.667827 18441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:53.669030 18441 hybrid_clock.cc:648] HybridClock initialized: now 1786474613669013 us; error 52 us; skew 500 ppm
Aug 11 18:56:53 dist-test-slave-68xk krb5kdc[18292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474613, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:53.671855 18441 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:56:53.672315 18441 webserver.cc:460] Webserver started at http://127.23.226.193:46871/ using document root <none> and password file <none>
I20260811 18:56:53.672577 18441 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:53.672648 18441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:53.672806 18441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:53.673868 18441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "ecf77fa1654a443c89a3a14fc139ca70"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "6559cc330bbcab056eac37ee19b21f7d"
server_key_iv: "1aebcf4d110006278c1eac260c164461"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.674244 18441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "ecf77fa1654a443c89a3a14fc139ca70"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "6559cc330bbcab056eac37ee19b21f7d"
server_key_iv: "1aebcf4d110006278c1eac260c164461"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.675768 18441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:53.676800 18462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:53.677059 18441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:53.677189 18441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "ecf77fa1654a443c89a3a14fc139ca70"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "6559cc330bbcab056eac37ee19b21f7d"
server_key_iv: "1aebcf4d110006278c1eac260c164461"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.677280 18441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:53.710275 18441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:53.712456 18441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:53.712653 18441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:53.712918 18441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:53.713256 18441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:53.713313 18441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:53.713351 18441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:53.713399 18441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:53.719872 18441 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:39273
I20260811 18:56:53.719969 18618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:39273 every 8 connection(s)
I20260811 18:56:53.720299 18441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:56:53 dist-test-slave-68xk krb5kdc[18292](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474613, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:53.726919 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 18441
I20260811 18:56:53.727067 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:56:53.727284 24459 external_mini_cluster.cc:1428] Setting key 4f73e6192196812f44861dc433983557
I20260811 18:56:53.730705 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:53.721075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:49959 (local address 127.23.226.254:41167)
0811 18:56:53.721189 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:53.721192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:53.721376 (+ 184us) server_negotiation.cc:407] Connection header received
0811 18:56:53.721861 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:53.721862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:53.721876 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:53.721938 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:53.722967 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.723547 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.724549 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.724781 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.724842 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:53.727005 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:53.727007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:53.727007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:53.727020 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:53.729044 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:53.729491 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:53.729493 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:53.729493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:53.729562 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:53.729899 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:53.729900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:53.729901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:53.730057 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:53.730150 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:53.730551 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 18:56:53.730636 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 18:56:53.730973 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:53.721047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41167 (local address 127.23.226.193:49959)
0811 18:56:53.721238 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:53.721283 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:53.721773 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:53.721991 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:53.721994 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:53.722672 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:53.722867 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:53.722873 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.723645 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.723646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:53.724455 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:53.724458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.724861 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.724862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:53.724962 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:53.725453 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:53.725461 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:53.726898 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:53.729151 (+ 2253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:53.729158 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:53.729160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:53.729392 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:53.729672 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:53.729674 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:53.729674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:53.729816 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:53.730161 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:53.730171 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:53.730361 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 18:56:53.730514 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 18:56:53.730708 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
I20260811 18:56:53.731539 18620 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41167
I20260811 18:56:53.731657 18620 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:53.731864 18620 heartbeater.cc:511] Master 127.23.226.254:41167 requested a full tablet report, sending...
I20260811 18:56:53.732501 18354 ts_manager.cc:194] Registered new tserver with Master: ecf77fa1654a443c89a3a14fc139ca70 (127.23.226.193:39273)
I20260811 18:56:53.733497 18354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:49959
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:56:53.756918 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41167
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:53.845755 18628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:53.845973 18628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:53.845999 18628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:53.847347 18628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:53.847395 18628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:53.847425 18628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:56:53.849051 18628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:53.849336 18628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:53.849606 18628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:53.855167 18634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:53.855285 18635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:53.855166 18637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:53.855515 18628 server_base.cc:1034] running on GCE node
I20260811 18:56:53.855798 18628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:53.856021 18628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:53.857172 18628 hybrid_clock.cc:648] HybridClock initialized: now 1786474613857150 us; error 41 us; skew 500 ppm
Aug 11 18:56:53 dist-test-slave-68xk krb5kdc[18292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474613, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:53.860054 18628 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:56:53.860564 18628 webserver.cc:460] Webserver started at http://127.23.226.194:32979/ using document root <none> and password file <none>
I20260811 18:56:53.860828 18628 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:53.860877 18628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:53.861008 18628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:53.862107 18628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "3dde5adcb8a54b9fa73d7f0936e8915a"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "01bd33a543dbf668157b5bb98a199f47"
server_key_iv: "e7d1b33d90d5a18beb5dc207c204a6a1"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.862533 18628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "3dde5adcb8a54b9fa73d7f0936e8915a"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "01bd33a543dbf668157b5bb98a199f47"
server_key_iv: "e7d1b33d90d5a18beb5dc207c204a6a1"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.864046 18628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:53.864871 18648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:53.865072 18628 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:53.865191 18628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "3dde5adcb8a54b9fa73d7f0936e8915a"
format_stamp: "Formatted at 2026-08-11 18:56:53 on dist-test-slave-68xk"
server_key: "01bd33a543dbf668157b5bb98a199f47"
server_key_iv: "e7d1b33d90d5a18beb5dc207c204a6a1"
server_key_version: "encryptionkey@0"
I20260811 18:56:53.865276 18628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:53.892239 18628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:53.894801 18628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:53.895011 18628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:53.895309 18628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:53.895694 18628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:53.895758 18628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:53.895807 18628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:53.895865 18628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:53.902683 18628 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:34485
I20260811 18:56:53.902776 18815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:34485 every 8 connection(s)
I20260811 18:56:53.903141 18628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:56:53 dist-test-slave-68xk krb5kdc[18292](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474613, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:53.912943 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 18628
I20260811 18:56:53.913074 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:56:53.913311 24459 external_mini_cluster.cc:1428] Setting key 2b97198f69f1dc423f517193a033b56d
I20260811 18:56:53.913425 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:53.903995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:56993 (local address 127.23.226.254:41167)
0811 18:56:53.904048 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:53.904051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:53.904254 (+ 203us) server_negotiation.cc:407] Connection header received
0811 18:56:53.904818 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:53.904820 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:53.904834 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:53.904899 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:53.905944 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.906524 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.907550 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.907760 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.907838 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:53.910179 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:53.910180 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:53.910180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:53.910188 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:53.911812 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:53.912218 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:53.912219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:53.912220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:53.912287 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:53.912526 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:53.912527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:53.912527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:53.912656 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:53.912717 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:53.913214 (+ 497us) server_negotiation.cc:299] Negotiation successful
0811 18:56:53.913303 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:56:53.913522 18819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:53.903950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41167 (local address 127.23.226.194:56993)
0811 18:56:53.904105 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:53.904156 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:53.904698 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:53.904971 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:53.904975 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:53.905629 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:53.905831 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:53.905835 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.906624 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.906625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:53.907446 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:53.907448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:53.907847 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:53.907848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:53.908000 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:53.908593 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:53.908602 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:53.910018 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:53.911894 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:53.911901 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:53.911902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:53.912121 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:53.912362 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:53.912362 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:53.912363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:53.912463 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:53.912779 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:53.912786 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:53.912965 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 18:56:53.913096 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 18:56:53.913281 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260811 18:56:53.914108 18816 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41167
I20260811 18:56:53.914243 18816 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:53.914502 18816 heartbeater.cc:511] Master 127.23.226.254:41167 requested a full tablet report, sending...
I20260811 18:56:53.915010 18354 ts_manager.cc:194] Registered new tserver with Master: 3dde5adcb8a54b9fa73d7f0936e8915a (127.23.226.194:34485)
I20260811 18:56:53.915572 18354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:56993
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:56:53.942382 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41167
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:34259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:54.028429 18822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:54.028664 18822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:54.028705 18822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:54.029893 18822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:54.029958 18822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:54.030002 18822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:56:54.031563 18822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:41167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:54.031844 18822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:54.032087 18822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:54.037452 18830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:54.037460 18832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:54.037560 18822 server_base.cc:1034] running on GCE node
W20260811 18:56:54.037477 18828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:54.038012 18822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:54.038295 18822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:54.039479 18822 hybrid_clock.cc:648] HybridClock initialized: now 1786474614039465 us; error 53 us; skew 500 ppm
Aug 11 18:56:54 dist-test-slave-68xk krb5kdc[18292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474614, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:54.042315 18822 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:56:54.042874 18822 webserver.cc:460] Webserver started at http://127.23.226.195:40139/ using document root <none> and password file <none>
I20260811 18:56:54.043150 18822 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:54.043228 18822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:54.043385 18822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:54.044461 18822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "d524f716b7c64108b59524ec22ffceea"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "1d8464e02480edad25f920e68d55fd41"
server_key_iv: "30cf51fe40c84a08ab1fae33294db8de"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.044840 18822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "d524f716b7c64108b59524ec22ffceea"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "1d8464e02480edad25f920e68d55fd41"
server_key_iv: "30cf51fe40c84a08ab1fae33294db8de"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.046239 18822 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:56:54.047098 18846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.047279 18822 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:54.047391 18822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "d524f716b7c64108b59524ec22ffceea"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "1d8464e02480edad25f920e68d55fd41"
server_key_iv: "30cf51fe40c84a08ab1fae33294db8de"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.047470 18822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:54.067561 18822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:54.070714 18822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:54.070909 18822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:54.071201 18822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:54.071580 18822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:54.071646 18822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.071696 18822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:54.071733 18822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.078864 18822 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:45533
I20260811 18:56:54.078922 19004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:45533 every 8 connection(s)
I20260811 18:56:54.079275 18822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:56:54 dist-test-slave-68xk krb5kdc[18292](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474614, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:54.088872 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 18822
I20260811 18:56:54.088985 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:56:54.089258 24459 external_mini_cluster.cc:1428] Setting key 37ae4eca0eaac7870fd30acca77fd76b
I20260811 18:56:54.089573 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.080066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:59633 (local address 127.23.226.254:41167)
0811 18:56:54.080299 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.080302 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.080498 (+ 196us) server_negotiation.cc:407] Connection header received
0811 18:56:54.081130 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.081131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.081154 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.081206 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:54.082242 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.082849 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.083885 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.084092 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.084181 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.086374 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:54.086375 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:54.086376 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:54.086389 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:54.087875 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:54.088334 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:54.088335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:54.088336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:54.088401 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:54.088715 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:54.088717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:54.088717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:54.088887 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:54.088983 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.089355 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.089461 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:56:54.089771 19008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.080047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:41167 (local address 127.23.226.195:59633)
0811 18:56:54.080368 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.080407 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.081009 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.081284 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.081288 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.081924 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:54.082137 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.082142 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.082949 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.082950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.083775 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.083777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.084196 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.084198 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.084328 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.084845 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:54.084854 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:54.086262 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:54.087991 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:54.088000 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:54.088002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:54.088249 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:54.088474 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:54.088475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:54.088475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:54.088589 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:54.089018 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:54.089026 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:54.089209 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.089302 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.089508 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":103,"threads_started":1}
I20260811 18:56:54.090245 19005 heartbeater.cc:347] Connected to a master server at 127.23.226.254:41167
I20260811 18:56:54.090335 19005 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:54.090549 19005 heartbeater.cc:511] Master 127.23.226.254:41167 requested a full tablet report, sending...
I20260811 18:56:54.090909 18354 ts_manager.cc:194] Registered new tserver with Master: d524f716b7c64108b59524ec22ffceea (127.23.226.195:45533)
I20260811 18:56:54.091239 18354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:59633
I20260811 18:56:54.100988 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:56:54.108628 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.102399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58656 (local address 127.23.226.254:41167)
0811 18:56:54.102481 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.102483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.102585 (+ 102us) server_negotiation.cc:407] Connection header received
0811 18:56:54.102625 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.102626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.102635 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.102683 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:54.103227 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.103691 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.104397 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.104598 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.104663 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.105863 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:54.105865 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:54.105865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:54.105880 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:54.107497 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:54.107859 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:54.107860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:54.107861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:54.107919 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:54.108131 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:54.108132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:54.108132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:54.108273 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:54.108351 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.108454 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.108519 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 18:56:54.110270 18354 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58656:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:56:54.111953 18354 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:56:54.119024 19030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.114550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39273 (local address 127.0.0.1:40510)
0811 18:56:54.115029 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.115040 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.115119 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.115449 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.115451 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.115453 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:54.115494 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.115496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.116764 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.116765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.117693 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.117696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.118723 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.118725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.118803 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.118817 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.118890 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.118948 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":88,"threads_started":1}
I20260811 18:56:54.119035 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.114817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40510 (local address 127.23.226.193:39273)
0811 18:56:54.115051 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.115056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.115213 (+ 157us) server_negotiation.cc:407] Connection header received
0811 18:56:54.115260 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.115262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.115280 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.115353 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:54.115604 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.116661 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.117780 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.118539 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.118626 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.118684 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.118908 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.118950 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":107,"threads_started":1}
I20260811 18:56:54.119381 19024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.114469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46978 (local address 127.23.226.194:34485)
0811 18:56:54.114798 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.114804 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.114816 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:56:54.114860 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.114863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.114881 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.114981 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:54.115201 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.116359 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.117943 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.118701 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.118774 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.118826 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.119072 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.119275 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":141,"threads_started":1}
I20260811 18:56:54.119853 19022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.114293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:45533 (local address 127.0.0.1:59966)
0811 18:56:54.114516 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.114574 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.114645 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.115420 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.115421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.115423 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:54.115466 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.115469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.116494 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.116495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.117857 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.117858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.119571 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.119572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.119647 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.119651 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.119718 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.119759 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":54,"thread_start_us":74,"threads_started":1}
I20260811 18:56:54.119876 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.114319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:34485 (local address 127.0.0.1:46978)
0811 18:56:54.114714 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.114724 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.114769 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.115014 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.115018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.115020 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:54.115099 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.115101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.116465 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.116467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.117855 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.117858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.118792 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.118794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.118871 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.118876 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.118954 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.119006 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":84,"thread_start_us":112,"threads_started":1}
I20260811 18:56:54.120211 18525 tablet_service.cc:1467] Processing CreateTablet for tablet 9abe66bf0ae34b0ab2e1a2c25558497d (DEFAULT_TABLE table=test-table [id=5a331519ff814db894b6a08fb4df9c81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:54.120620 18525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9abe66bf0ae34b0ab2e1a2c25558497d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:54.120673 18715 tablet_service.cc:1467] Processing CreateTablet for tablet 9abe66bf0ae34b0ab2e1a2c25558497d (DEFAULT_TABLE table=test-table [id=5a331519ff814db894b6a08fb4df9c81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:54.121037 18715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9abe66bf0ae34b0ab2e1a2c25558497d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:54.122694 19026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.114490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59966 (local address 127.23.226.195:45533)
0811 18:56:54.115166 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.115171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.115180 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:56:54.115258 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.115260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.115275 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.115350 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:54.115553 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.116373 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.118533 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.119362 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.119462 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.119529 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.122545 (+ 3016us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.122611 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":144,"threads_started":1}
I20260811 18:56:54.123406 18914 tablet_service.cc:1467] Processing CreateTablet for tablet 9abe66bf0ae34b0ab2e1a2c25558497d (DEFAULT_TABLE table=test-table [id=5a331519ff814db894b6a08fb4df9c81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:54.123744 18914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9abe66bf0ae34b0ab2e1a2c25558497d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:54.123776 19032 tablet_bootstrap.cc:492] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70: Bootstrap starting.
I20260811 18:56:54.124096 19033 tablet_bootstrap.cc:492] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Bootstrap starting.
I20260811 18:56:54.124576 19032 tablet_bootstrap.cc:654] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:54.124809 19033 tablet_bootstrap.cc:654] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:54.125313 19032 log.cc:824] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:54.125542 19033 log.cc:824] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:54.126224 19032 tablet_bootstrap.cc:492] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70: No bootstrap required, opened a new log
I20260811 18:56:54.126304 19032 ts_tablet_manager.cc:1397] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:56:54.126353 19033 tablet_bootstrap.cc:492] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: No bootstrap required, opened a new log
I20260811 18:56:54.126472 19033 ts_tablet_manager.cc:1397] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:56:54.127547 19037 tablet_bootstrap.cc:492] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: Bootstrap starting.
I20260811 18:56:54.128264 19037 tablet_bootstrap.cc:654] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:54.128193 19032 raft_consensus.cc:348] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
I20260811 18:56:54.128346 19032 raft_consensus.cc:374] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:54.128391 19032 raft_consensus.cc:729] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf77fa1654a443c89a3a14fc139ca70, State: Initialized, Role: FOLLOWER
I20260811 18:56:54.128500 19032 consensus_queue.cc:260] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
I20260811 18:56:54.128808 19032 ts_tablet_manager.cc:1428] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:56:54.128911 19037 log.cc:824] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:54.128794 19033 raft_consensus.cc:348] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
I20260811 18:56:54.128985 18620 heartbeater.cc:503] Master 127.23.226.254:41167 was elected leader, sending a full tablet report...
I20260811 18:56:54.128993 19033 raft_consensus.cc:374] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:54.129035 19033 raft_consensus.cc:729] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dde5adcb8a54b9fa73d7f0936e8915a, State: Initialized, Role: FOLLOWER
I20260811 18:56:54.129189 19033 consensus_queue.cc:260] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
I20260811 18:56:54.129504 19033 ts_tablet_manager.cc:1428] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:56:54.129750 18816 heartbeater.cc:503] Master 127.23.226.254:41167 was elected leader, sending a full tablet report...
I20260811 18:56:54.129737 19037 tablet_bootstrap.cc:492] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: No bootstrap required, opened a new log
I20260811 18:56:54.129829 19037 ts_tablet_manager.cc:1397] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:56:54.131659 19037 raft_consensus.cc:348] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
I20260811 18:56:54.131800 19037 raft_consensus.cc:374] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:54.131827 19037 raft_consensus.cc:729] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d524f716b7c64108b59524ec22ffceea, State: Initialized, Role: FOLLOWER
I20260811 18:56:54.131909 19037 consensus_queue.cc:260] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
I20260811 18:56:54.132160 19037 ts_tablet_manager.cc:1428] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 18:56:54.132234 19005 heartbeater.cc:503] Master 127.23.226.254:41167 was elected leader, sending a full tablet report...
I20260811 18:56:54.145254 19045 raft_consensus.cc:482] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:54.145355 19045 raft_consensus.cc:504] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
I20260811 18:56:54.145752 19045 leader_election.cc:288] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecf77fa1654a443c89a3a14fc139ca70 (127.23.226.193:39273), 3dde5adcb8a54b9fa73d7f0936e8915a (127.23.226.194:34485)
I20260811 18:56:54.149544 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.145969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:55293 (local address 127.23.226.193:39273)
0811 18:56:54.146034 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.146037 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.146048 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:56:54.146080 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.146080 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.146091 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.146155 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:54.146344 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.147115 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.148504 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.149113 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.149194 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.149202 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.149433 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.149480 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:56:54.149544 19008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.145895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39273 (local address 127.23.226.195:55293)
0811 18:56:54.145964 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.145976 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.146023 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.146177 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.146178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.146179 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:54.146259 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.146261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.147206 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.147207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.148408 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.148412 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.149229 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.149230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.149319 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.149323 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.149389 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.149448 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":3}
I20260811 18:56:54.149554 19047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.145963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:34485 (local address 127.23.226.195:44927)
0811 18:56:54.146181 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.146191 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.146249 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.146388 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.146388 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.146389 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:54.146480 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.146482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.147325 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.147326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.148478 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.148480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.149238 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.149239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.149319 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.149323 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.149389 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.149448 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":37,"thread_start_us":135,"threads_started":1}
I20260811 18:56:54.149585 19024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.146018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:44927 (local address 127.23.226.194:34485)
0811 18:56:54.146059 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.146061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.146263 (+ 202us) server_negotiation.cc:407] Connection header received
0811 18:56:54.146316 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.146317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.146328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.146379 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:54.146556 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.147249 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.148560 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.149125 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.149193 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.149202 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.149460 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.149505 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:56:54.150024 18550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9abe66bf0ae34b0ab2e1a2c25558497d" candidate_uuid: "d524f716b7c64108b59524ec22ffceea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf77fa1654a443c89a3a14fc139ca70" is_pre_election: true
I20260811 18:56:54.150017 18746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9abe66bf0ae34b0ab2e1a2c25558497d" candidate_uuid: "d524f716b7c64108b59524ec22ffceea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" is_pre_election: true
I20260811 18:56:54.150193 18550 raft_consensus.cc:2454] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d524f716b7c64108b59524ec22ffceea in term 0.
I20260811 18:56:54.150202 18746 raft_consensus.cc:2454] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d524f716b7c64108b59524ec22ffceea in term 0.
I20260811 18:56:54.150476 18849 leader_election.cc:302] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dde5adcb8a54b9fa73d7f0936e8915a, d524f716b7c64108b59524ec22ffceea; no voters:
I20260811 18:56:54.150626 19045 raft_consensus.cc:2781] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:56:54.150789 19045 raft_consensus.cc:482] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:56:54.150863 19045 raft_consensus.cc:3037] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:54.151602 19045 raft_consensus.cc:504] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
I20260811 18:56:54.151772 19045 leader_election.cc:288] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [CANDIDATE]: Term 1 election: Requested vote from peers ecf77fa1654a443c89a3a14fc139ca70 (127.23.226.193:39273), 3dde5adcb8a54b9fa73d7f0936e8915a (127.23.226.194:34485)
I20260811 18:56:54.151937 18550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9abe66bf0ae34b0ab2e1a2c25558497d" candidate_uuid: "d524f716b7c64108b59524ec22ffceea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf77fa1654a443c89a3a14fc139ca70"
I20260811 18:56:54.151955 18746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9abe66bf0ae34b0ab2e1a2c25558497d" candidate_uuid: "d524f716b7c64108b59524ec22ffceea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a"
I20260811 18:56:54.152030 18746 raft_consensus.cc:3037] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:54.152030 18550 raft_consensus.cc:3037] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:54.153034 18746 raft_consensus.cc:2454] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d524f716b7c64108b59524ec22ffceea in term 1.
I20260811 18:56:54.153086 18550 raft_consensus.cc:2454] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d524f716b7c64108b59524ec22ffceea in term 1.
I20260811 18:56:54.153226 18849 leader_election.cc:302] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dde5adcb8a54b9fa73d7f0936e8915a, d524f716b7c64108b59524ec22ffceea; no voters:
I20260811 18:56:54.153312 19045 raft_consensus.cc:2781] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:54.153471 19045 raft_consensus.cc:686] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 1 LEADER]: Becoming Leader. State: Replica: d524f716b7c64108b59524ec22ffceea, State: Running, Role: LEADER
I20260811 18:56:54.153582 19045 consensus_queue.cc:237] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } }
W20260811 18:56:54.153807 18818 tablet.cc:2369] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:56:54.154541 18354 catalog_manager.cc:5495] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea reported cstate change: term changed from 0 to 1, leader changed from <none> to d524f716b7c64108b59524ec22ffceea (127.23.226.195). New cstate: current_term: 1 leader_uuid: "d524f716b7c64108b59524ec22ffceea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d524f716b7c64108b59524ec22ffceea" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 } health_report { overall_health: UNKNOWN } } }
I20260811 18:56:54.167213 19026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.164744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59980 (local address 127.23.226.195:45533)
0811 18:56:54.164820 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.164822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.164830 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:56:54.164860 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.164861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.164878 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.164949 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:56:54.165124 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.165623 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.166385 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.166658 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.166720 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.166884 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:56:54.166981 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:56:54.167053 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.167086 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.167105 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:56:54.169185 18550 raft_consensus.cc:1261] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 1 FOLLOWER]: Refusing update from remote peer d524f716b7c64108b59524ec22ffceea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:54.169185 18746 raft_consensus.cc:1261] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 1 FOLLOWER]: Refusing update from remote peer d524f716b7c64108b59524ec22ffceea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:54.169544 19048 consensus_queue.cc:1035] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf77fa1654a443c89a3a14fc139ca70" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 39273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:54.169659 19045 consensus_queue.cc:1035] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dde5adcb8a54b9fa73d7f0936e8915a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:54.172441 19055 mvcc.cc:205] Tried to move back new op lower bound from 7317400019633709056 to 7317400019573923840. Current Snapshot: MvccSnapshot[applied={T|T < 7317400019633709056}]
I20260811 18:56:54.172673 19056 mvcc.cc:205] Tried to move back new op lower bound from 7317400019633709056 to 7317400019573923840. Current Snapshot: MvccSnapshot[applied={T|T < 7317400019633709056}]
I20260811 18:56:54.174765 18351 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:54.174871 18351 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:54.175668 18351 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4bf02e08191f409a8cf9ea0b65935a7b: Sending DeleteTablet for 3 replicas of tablet 9abe66bf0ae34b0ab2e1a2c25558497d
I20260811 18:56:54.175987 18914 tablet_service.cc:1514] Processing DeleteTablet for tablet 9abe66bf0ae34b0ab2e1a2c25558497d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:59966
I20260811 18:56:54.176048 18525 tablet_service.cc:1514] Processing DeleteTablet for tablet 9abe66bf0ae34b0ab2e1a2c25558497d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:40510
I20260811 18:56:54.176046 18715 tablet_service.cc:1514] Processing DeleteTablet for tablet 9abe66bf0ae34b0ab2e1a2c25558497d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:54 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:46978
I20260811 18:56:54.176308 19067 tablet_replica.cc:330] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70: stopping tablet replica
I20260811 18:56:54.176416 19067 raft_consensus.cc:2229] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:54.176463 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 18441
I20260811 18:56:54.176520 19067 raft_consensus.cc:2258] T 9abe66bf0ae34b0ab2e1a2c25558497d P ecf77fa1654a443c89a3a14fc139ca70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:54.183220 19066 tablet_replica.cc:330] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: stopping tablet replica
I20260811 18:56:54.183382 19066 raft_consensus.cc:2229] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:56:54.183578 19066 raft_consensus.cc:2258] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:54.184239 19069 tablet_replica.cc:330] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: stopping tablet replica
I20260811 18:56:54.184345 19069 raft_consensus.cc:2229] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:54.184432 19069 raft_consensus.cc:2258] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:54.185947 19069 ts_tablet_manager.cc:1905] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:54.186137 19066 ts_tablet_manager.cc:1905] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:54.187776 19069 ts_tablet_manager.cc:1918] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:54.187853 19069 log.cc:1196] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/9abe66bf0ae34b0ab2e1a2c25558497d
I20260811 18:56:54.188104 19069 ts_tablet_manager.cc:1939] T 9abe66bf0ae34b0ab2e1a2c25558497d P 3dde5adcb8a54b9fa73d7f0936e8915a: Deleting consensus metadata
I20260811 18:56:54.188395 19066 ts_tablet_manager.cc:1918] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:54.188495 19066 log.cc:1196] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/9abe66bf0ae34b0ab2e1a2c25558497d
I20260811 18:56:54.188932 19066 ts_tablet_manager.cc:1939] T 9abe66bf0ae34b0ab2e1a2c25558497d P d524f716b7c64108b59524ec22ffceea: Deleting consensus metadata
I20260811 18:56:54.190899 18336 catalog_manager.cc:4841] TS 3dde5adcb8a54b9fa73d7f0936e8915a (127.23.226.194:34485): tablet 9abe66bf0ae34b0ab2e1a2c25558497d (table test-table [id=5a331519ff814db894b6a08fb4df9c81]) successfully deleted
I20260811 18:56:54.191816 18337 catalog_manager.cc:4841] TS d524f716b7c64108b59524ec22ffceea (127.23.226.195:45533): tablet 9abe66bf0ae34b0ab2e1a2c25558497d (table test-table [id=5a331519ff814db894b6a08fb4df9c81]) successfully deleted
W20260811 18:56:54.197147 18337 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:39273 (error 108)
I20260811 18:56:54.197386 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 18628
I20260811 18:56:54.225343 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.225152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:39273 (local address 127.0.0.1:40524)
0811 18:56:54.225221 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.225281 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:39273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 18:56:54.226526 18337 catalog_manager.cc:4584] TS ecf77fa1654a443c89a3a14fc139ca70 (127.23.226.193:39273): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9abe66bf0ae34b0ab2e1a2c25558497d: Network error: Client connection negotiation failed: client connection to 127.23.226.193:39273: connect: Connection refused (error 111)
I20260811 18:56:54.232436 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 18822
I20260811 18:56:54.243314 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 18309
2026-08-11T18:56:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2348 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T18:56:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:56:54Z Disabled control of system clock
I20260811 18:56:54.277854 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37163
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:34985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:37163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:56:54.359282 19076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:54.359549 19076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:54.359586 19076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:54.360728 19076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:54.360798 19076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:54.360818 19076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:54.360838 19076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:54.360872 19076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:54.362252 19076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:37163
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:54.362563 19076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:54.362864 19076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:54.367636 19087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:54.367650 19084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:54.367868 19085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:54.367877 19076 server_base.cc:1034] running on GCE node
I20260811 18:56:54.368151 19076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:54.368464 19076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:54.369654 19076 hybrid_clock.cc:648] HybridClock initialized: now 1786474614369624 us; error 42 us; skew 500 ppm
I20260811 18:56:54.371044 19076 webserver.cc:460] Webserver started at http://127.23.226.254:45573/ using document root <none> and password file <none>
I20260811 18:56:54.371312 19076 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:54.371392 19076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:54.371562 19076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:54.372655 19076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "1415e2caf3c0439fa0cf700bbbb734d3"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "10171f523f7b09bcd3458a23afc5a7bb"
server_key_iv: "a42102db15393d977e2520e44651f0d7"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.373039 19076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "1415e2caf3c0439fa0cf700bbbb734d3"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "10171f523f7b09bcd3458a23afc5a7bb"
server_key_iv: "a42102db15393d977e2520e44651f0d7"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.374516 19076 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:56:54.375367 19094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.375554 19076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:54.375671 19076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "1415e2caf3c0439fa0cf700bbbb734d3"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "10171f523f7b09bcd3458a23afc5a7bb"
server_key_iv: "a42102db15393d977e2520e44651f0d7"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.375749 19076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:54.412611 19076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:54.413009 19076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:54.413189 19076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:54.417586 19076 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:37163
I20260811 18:56:54.417632 19169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:37163 every 8 connection(s)
I20260811 18:56:54.418030 19076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:54.419088 19170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:54.421348 19170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3: Bootstrap starting.
I20260811 18:56:54.421939 19170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:54.422195 19170 log.cc:824] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:54.422811 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 19076
I20260811 18:56:54.422933 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:56:54.423025 19170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3: No bootstrap required, opened a new log
I20260811 18:56:54.423200 24459 external_mini_cluster.cc:1428] Setting key 3a3d357815512396f96fa00985ef8d91
I20260811 18:56:54.424979 19170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1415e2caf3c0439fa0cf700bbbb734d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37163 } }
I20260811 18:56:54.425163 19170 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:54.425230 19170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1415e2caf3c0439fa0cf700bbbb734d3, State: Initialized, Role: FOLLOWER
I20260811 18:56:54.425369 19170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1415e2caf3c0439fa0cf700bbbb734d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37163 } }
I20260811 18:56:54.425474 19170 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:54.425521 19170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:54.425570 19170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:54.426102 19170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1415e2caf3c0439fa0cf700bbbb734d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37163 } }
I20260811 18:56:54.426229 19170 leader_election.cc:302] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1415e2caf3c0439fa0cf700bbbb734d3; no voters:
I20260811 18:56:54.426446 19170 leader_election.cc:288] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:56:54.426489 19176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:54.426649 19176 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [term 1 LEADER]: Becoming Leader. State: Replica: 1415e2caf3c0439fa0cf700bbbb734d3, State: Running, Role: LEADER
I20260811 18:56:54.426738 19170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:54.426834 19176 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1415e2caf3c0439fa0cf700bbbb734d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37163 } }
I20260811 18:56:54.427294 19176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1415e2caf3c0439fa0cf700bbbb734d3. Latest consensus state: current_term: 1 leader_uuid: "1415e2caf3c0439fa0cf700bbbb734d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1415e2caf3c0439fa0cf700bbbb734d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37163 } } }
I20260811 18:56:54.427474 19176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [sys.catalog]: This master's current role is: LEADER
W20260811 18:56:54.428637 19197 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:56:54.428690 19197 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:56:54.427304 19180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1415e2caf3c0439fa0cf700bbbb734d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1415e2caf3c0439fa0cf700bbbb734d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37163 } } }
I20260811 18:56:54.428830 19180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:54.429479 19202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:54.429702 19202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:56:54.430960 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.423820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.23.226.254:37163)
0811 18:56:54.424050 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.424059 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.424086 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:56:54.424973 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.424980 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.425056 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.425213 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:54.425456 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.427303 (+ 1847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.428577 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.429194 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.429299 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.430089 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:54.430093 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:54.430093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:54.430336 (+ 243us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:54.430387 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:54.430404 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:54.430498 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.430583 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.430678 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260811 18:56:54.431485 19202 catalog_manager.cc:1347] Generated new cluster ID: 98a4770bbf1d4091ae8ff8a6185a6a39
I20260811 18:56:54.431536 19202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:56:54.452287 19202 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:56:54.453015 19202 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:54.463771 19202 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3: Generated new TSK 0
I20260811 18:56:54.463990 19202 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:56:54.471393 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37163
--builtin_ntp_servers=127.23.226.212:34985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:56:54.562273 19206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:54.562546 19206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:54.562582 19206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:54.563733 19206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:54.563802 19206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:54.563844 19206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:56:54.565222 19206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:54.565485 19206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:54.565793 19206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:54.571048 19215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:54.571056 19213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:54.571058 19212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:54.571352 19206 server_base.cc:1034] running on GCE node
I20260811 18:56:54.571662 19206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:54.571946 19206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:54.573163 19206 hybrid_clock.cc:648] HybridClock initialized: now 1786474614573130 us; error 43 us; skew 500 ppm
I20260811 18:56:54.574689 19206 webserver.cc:460] Webserver started at http://127.23.226.193:33895/ using document root <none> and password file <none>
I20260811 18:56:54.574978 19206 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:54.575057 19206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:54.575241 19206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:54.576447 19206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "45ebd25cf5d64581ae15f59c9aafe7c6"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "a65cbce9bad36637497503d891ff5d93"
server_key_iv: "55c804a3bf003077c22a944c76c5b5d0"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.576858 19206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "45ebd25cf5d64581ae15f59c9aafe7c6"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "a65cbce9bad36637497503d891ff5d93"
server_key_iv: "55c804a3bf003077c22a944c76c5b5d0"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.578240 19206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:56:54.579216 19224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.579385 19206 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:54.579497 19206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "45ebd25cf5d64581ae15f59c9aafe7c6"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "a65cbce9bad36637497503d891ff5d93"
server_key_iv: "55c804a3bf003077c22a944c76c5b5d0"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.579618 19206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:54.591347 19206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:54.591709 19206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:54.591884 19206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:54.592154 19206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:54.592519 19206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:54.592588 19206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.592636 19206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:54.592669 19206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.599421 19206 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:34249
I20260811 18:56:54.599476 19395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:34249 every 8 connection(s)
I20260811 18:56:54.599848 19206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:56:54.605324 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.600655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:38665 (local address 127.23.226.254:37163)
0811 18:56:54.600725 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.600728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.600973 (+ 245us) server_negotiation.cc:407] Connection header received
0811 18:56:54.601522 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.601523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.601537 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.601599 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:54.602313 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.602921 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.603943 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.604167 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.604229 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.605060 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:54.605061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:54.605062 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:54.605066 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:54.605081 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:54.605085 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:54.605133 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.605238 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.605265 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:56:54.605556 19401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.600652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37163 (local address 127.23.226.193:38665)
0811 18:56:54.600844 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.600878 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.601402 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.601683 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.601687 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.601695 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:54.602199 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.602204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.603033 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.603034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.603850 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.603852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.604256 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.604257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.604369 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.604916 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:56:54.604916 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:54.604944 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:56:54.604967 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:54.605142 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:54.605170 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:54.605173 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.605227 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.605306 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260811 18:56:54.606161 19398 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37163
I20260811 18:56:54.606267 19398 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:54.606539 19398 heartbeater.cc:511] Master 127.23.226.254:37163 requested a full tablet report, sending...
I20260811 18:56:54.607110 19114 ts_manager.cc:194] Registered new tserver with Master: 45ebd25cf5d64581ae15f59c9aafe7c6 (127.23.226.193:34249)
I20260811 18:56:54.607748 19114 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.193:38665
I20260811 18:56:54.607988 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 19206
I20260811 18:56:54.608101 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:56:54.608332 24459 external_mini_cluster.cc:1428] Setting key 8c7696c390f94c1d635f29f2bbd577b9
I20260811 18:56:54.609318 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37163
--builtin_ntp_servers=127.23.226.212:34985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:56:54.695020 19402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:54.695273 19402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:54.695310 19402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:54.696461 19402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:54.696529 19402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:54.696570 19402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:56:54.697932 19402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:54.698208 19402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:54.698529 19402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:54.703886 19410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:54.703999 19402 server_base.cc:1034] running on GCE node
W20260811 18:56:54.703934 19409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:54.703896 19413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:54.704398 19402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:54.704654 19402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:54.705833 19402 hybrid_clock.cc:648] HybridClock initialized: now 1786474614705820 us; error 34 us; skew 500 ppm
I20260811 18:56:54.707347 19402 webserver.cc:460] Webserver started at http://127.23.226.194:41143/ using document root <none> and password file <none>
I20260811 18:56:54.707599 19402 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:54.707679 19402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:54.707835 19402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:54.708907 19402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "cb1fcde89d654a30a46f68000c355e88"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "8bf484f031784bc2b29e7ee4fe4c0d55"
server_key_iv: "8ecf7c866c75c8a708244646ad241517"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.709285 19402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "cb1fcde89d654a30a46f68000c355e88"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "8bf484f031784bc2b29e7ee4fe4c0d55"
server_key_iv: "8ecf7c866c75c8a708244646ad241517"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.710721 19402 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:56:54.711506 19421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.711666 19402 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:56:54.711766 19402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "cb1fcde89d654a30a46f68000c355e88"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "8bf484f031784bc2b29e7ee4fe4c0d55"
server_key_iv: "8ecf7c866c75c8a708244646ad241517"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.711851 19402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:54.725522 19402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:54.725872 19402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:54.726047 19402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:54.726325 19402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:54.726734 19402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:54.726792 19402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.726833 19402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:54.726881 19402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.733160 19402 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:39335
I20260811 18:56:54.733206 19609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:39335 every 8 connection(s)
I20260811 18:56:54.733584 19402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:56:54.735118 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 19402
I20260811 18:56:54.735213 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:56:54.735450 24459 external_mini_cluster.cc:1428] Setting key a1deaeda1b5261e898b454ced466277f
I20260811 18:56:54.736696 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37163
--builtin_ntp_servers=127.23.226.212:34985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:56:54.740113 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.734393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:48105 (local address 127.23.226.254:37163)
0811 18:56:54.734483 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.734485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.734709 (+ 224us) server_negotiation.cc:407] Connection header received
0811 18:56:54.735287 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.735288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.735301 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.735352 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:54.736407 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.737170 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.738378 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.738651 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.738748 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.739767 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:54.739769 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:54.739769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:54.739775 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:54.739792 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:54.739797 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:54.739873 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.739990 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.740025 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 18:56:54.740387 19615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.734353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37163 (local address 127.23.226.194:48105)
0811 18:56:54.734575 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.734617 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.735120 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.735443 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.735447 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.735455 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:54.736282 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.736291 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.737284 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.737285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.738256 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.738260 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.738756 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.738757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.738919 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.739589 (+ 670us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:56:54.739589 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:54.739624 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:56:54.739651 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:54.739877 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:54.739885 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:54.739888 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.739992 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.740128 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":124,"threads_started":1}
I20260811 18:56:54.741024 19610 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37163
I20260811 18:56:54.741164 19610 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:54.741374 19610 heartbeater.cc:511] Master 127.23.226.254:37163 requested a full tablet report, sending...
I20260811 18:56:54.741820 19114 ts_manager.cc:194] Registered new tserver with Master: cb1fcde89d654a30a46f68000c355e88 (127.23.226.194:39335)
I20260811 18:56:54.742234 19114 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.194:48105
W20260811 18:56:54.821898 19616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:54.822089 19616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:54.822113 19616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:54.823318 19616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:54.823388 19616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:54.823414 19616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:56:54.824744 19616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:34985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:54.824985 19616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:54.825305 19616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:54.831307 19624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:54.831349 19626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:54.831338 19623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:54.831521 19616 server_base.cc:1034] running on GCE node
I20260811 18:56:54.831736 19616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:54.831948 19616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:54.833101 19616 hybrid_clock.cc:648] HybridClock initialized: now 1786474614833048 us; error 78 us; skew 500 ppm
I20260811 18:56:54.834394 19616 webserver.cc:460] Webserver started at http://127.23.226.195:36823/ using document root <none> and password file <none>
I20260811 18:56:54.834733 19616 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:54.834785 19616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:54.834952 19616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:54.836083 19616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "1cd9d861c2444f528b74dcd770482cc3"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "9ebc127b67a966b361cf6bf688ab6932"
server_key_iv: "7010e1ed09218c76a2d145819c984c17"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.836479 19616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "1cd9d861c2444f528b74dcd770482cc3"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "9ebc127b67a966b361cf6bf688ab6932"
server_key_iv: "7010e1ed09218c76a2d145819c984c17"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.837900 19616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:56:54.838759 19635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.838985 19616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:54.839123 19616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "1cd9d861c2444f528b74dcd770482cc3"
format_stamp: "Formatted at 2026-08-11 18:56:54 on dist-test-slave-68xk"
server_key: "9ebc127b67a966b361cf6bf688ab6932"
server_key_iv: "7010e1ed09218c76a2d145819c984c17"
server_key_version: "encryptionkey@0"
I20260811 18:56:54.839198 19616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:54.855397 19616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:54.855749 19616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:54.855917 19616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:54.856191 19616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:54.856554 19616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:54.856593 19616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.856617 19616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:54.856631 19616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:54.862907 19616 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:45473
I20260811 18:56:54.862989 19793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:45473 every 8 connection(s)
I20260811 18:56:54.863335 19616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:56:54.868798 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.864189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:41753 (local address 127.23.226.254:37163)
0811 18:56:54.864266 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.864268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.864485 (+ 217us) server_negotiation.cc:407] Connection header received
0811 18:56:54.864998 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.865000 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.865012 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.865091 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:54.865776 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.866283 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.867282 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.867489 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.867555 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.868530 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:54.868531 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:54.868532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:54.868536 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:54.868550 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:54.868554 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:54.868609 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.868709 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.868737 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:56:54.869029 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.864103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37163 (local address 127.23.226.195:41753)
0811 18:56:54.864337 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.864380 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.864879 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.865172 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.865175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.865184 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:54.865695 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.865699 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.866365 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.866365 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.867163 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.867165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.867578 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.867579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.867704 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.868314 (+ 610us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:56:54.868314 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:54.868342 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:56:54.868365 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:54.868623 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:54.868628 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:54.868631 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.868692 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.868826 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":134,"threads_started":1}
I20260811 18:56:54.869511 19794 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37163
I20260811 18:56:54.869607 19794 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:54.869760 19794 heartbeater.cc:511] Master 127.23.226.254:37163 requested a full tablet report, sending...
I20260811 18:56:54.870133 19114 ts_manager.cc:194] Registered new tserver with Master: 1cd9d861c2444f528b74dcd770482cc3 (127.23.226.195:45473)
I20260811 18:56:54.870553 19114 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.195:41753
I20260811 18:56:54.873075 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 19616
I20260811 18:56:54.873250 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:56:54.873469 24459 external_mini_cluster.cc:1428] Setting key b49638514d834c994be541dca2814318
I20260811 18:56:54.874555 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:56:54.879359 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.876041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50580 (local address 127.23.226.254:37163)
0811 18:56:54.876141 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.876143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.876213 (+ 70us) server_negotiation.cc:407] Connection header received
0811 18:56:54.876289 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.876290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.876302 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.876347 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:54.876520 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.876981 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.877753 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.878001 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.878076 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.878826 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:54.878828 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:54.878829 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:54.878836 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:54.878853 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:54.878857 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:54.879072 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.879241 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.879268 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:56:54.880959 19114 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:56:54.882694 19114 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:56:54.889273 19806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.884991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39335 (local address 127.0.0.1:51990)
0811 18:56:54.885311 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.885323 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.885380 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.885911 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.885912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.885915 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:54.885960 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.885961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.886996 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.886997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.888259 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.888262 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.888971 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.888972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.889049 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.889061 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.889137 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.889194 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":2,"thread_start_us":83,"threads_started":1}
I20260811 18:56:54.889286 19809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.885275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51990 (local address 127.23.226.194:39335)
0811 18:56:54.885721 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.885724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.885736 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:56:54.885777 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.885779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.885796 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.886042 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:54.886101 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.886908 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.888369 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.888855 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.888971 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.889070 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.889159 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.889200 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":95,"threads_started":1}
I20260811 18:56:54.889500 19807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.884991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34249 (local address 127.0.0.1:53234)
0811 18:56:54.885247 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.885292 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.885360 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.885603 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.885606 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.885609 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:54.885687 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.885689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.887234 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.887235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.888267 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.888268 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.889219 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.889220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.889300 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.889307 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.889359 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.889410 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":25,"thread_start_us":106,"threads_started":1}
I20260811 18:56:54.889801 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.885201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53234 (local address 127.23.226.193:34249)
0811 18:56:54.885429 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.885435 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.885445 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:56:54.885494 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.885496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.885508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.885598 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:54.885957 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.887137 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.888335 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.889016 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.889092 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.889187 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.889654 (+ 467us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.889700 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":99,"threads_started":1}
I20260811 18:56:54.889889 19805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.885002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:45473 (local address 127.0.0.1:40628)
0811 18:56:54.885720 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:54.885731 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:54.885786 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:54.886011 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:54.886012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:54.886014 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:54.886052 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.886053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.887279 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.887281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.888192 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:54.888195 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.889217 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.889219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:54.889300 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.889309 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 18:56:54.889766 (+ 457us) client_negotiation.cc:240] Negotiation successful
0811 18:56:54.889811 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"mutex_wait_us":3,"thread_start_us":89,"threads_started":1}
I20260811 18:56:54.890196 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:54.885488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40628 (local address 127.23.226.195:45473)
0811 18:56:54.885660 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:54.885664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:54.885778 (+ 114us) server_negotiation.cc:407] Connection header received
0811 18:56:54.885850 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:54.885852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:54.885868 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:54.885947 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:54.886117 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.887217 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.888279 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:54.889016 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:54.889092 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:54.889174 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:54.889806 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 18:56:54.890116 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
I20260811 18:56:54.890069 19498 tablet_service.cc:1467] Processing CreateTablet for tablet 196a28f0d52542e8a1f42648d79c82b4 (DEFAULT_TABLE table=test-table [id=874d1dd118334c92bc94ef1d50c332ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:54.890525 19498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 196a28f0d52542e8a1f42648d79c82b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:54.893137 19811 tablet_bootstrap.cc:492] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Bootstrap starting.
I20260811 18:56:54.893673 19298 tablet_service.cc:1467] Processing CreateTablet for tablet 196a28f0d52542e8a1f42648d79c82b4 (DEFAULT_TABLE table=test-table [id=874d1dd118334c92bc94ef1d50c332ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:54.893893 19811 tablet_bootstrap.cc:654] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:54.894071 19298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 196a28f0d52542e8a1f42648d79c82b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:54.894229 19811 log.cc:824] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:54.895066 19811 tablet_bootstrap.cc:492] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: No bootstrap required, opened a new log
I20260811 18:56:54.895143 19811 ts_tablet_manager.cc:1397] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:56:54.897663 19814 tablet_bootstrap.cc:492] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6: Bootstrap starting.
I20260811 18:56:54.897853 19811 raft_consensus.cc:348] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:54.898015 19811 raft_consensus.cc:374] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:54.898061 19811 raft_consensus.cc:729] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1fcde89d654a30a46f68000c355e88, State: Initialized, Role: FOLLOWER
I20260811 18:56:54.898185 19811 consensus_queue.cc:260] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:54.898257 19703 tablet_service.cc:1467] Processing CreateTablet for tablet 196a28f0d52542e8a1f42648d79c82b4 (DEFAULT_TABLE table=test-table [id=874d1dd118334c92bc94ef1d50c332ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:54.898401 19814 tablet_bootstrap.cc:654] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:54.898518 19811 ts_tablet_manager.cc:1428] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 18:56:54.898586 19610 heartbeater.cc:503] Master 127.23.226.254:37163 was elected leader, sending a full tablet report...
I20260811 18:56:54.898664 19703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 196a28f0d52542e8a1f42648d79c82b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:54.899087 19814 log.cc:824] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:54.900066 19814 tablet_bootstrap.cc:492] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6: No bootstrap required, opened a new log
I20260811 18:56:54.900159 19814 ts_tablet_manager.cc:1397] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:56:54.901664 19818 tablet_bootstrap.cc:492] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: Bootstrap starting.
I20260811 18:56:54.902235 19818 tablet_bootstrap.cc:654] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:54.902336 19814 raft_consensus.cc:348] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:54.902546 19814 raft_consensus.cc:374] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:54.902596 19814 raft_consensus.cc:729] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ebd25cf5d64581ae15f59c9aafe7c6, State: Initialized, Role: FOLLOWER
I20260811 18:56:54.902595 19818 log.cc:824] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:54.902719 19814 consensus_queue.cc:260] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:54.902972 19814 ts_tablet_manager.cc:1428] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:56:54.903090 19398 heartbeater.cc:503] Master 127.23.226.254:37163 was elected leader, sending a full tablet report...
I20260811 18:56:54.903380 19818 tablet_bootstrap.cc:492] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: No bootstrap required, opened a new log
I20260811 18:56:54.903468 19818 ts_tablet_manager.cc:1397] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 18:56:54.905385 19818 raft_consensus.cc:348] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:54.905535 19818 raft_consensus.cc:374] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:54.905583 19818 raft_consensus.cc:729] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cd9d861c2444f528b74dcd770482cc3, State: Initialized, Role: FOLLOWER
I20260811 18:56:54.905704 19818 consensus_queue.cc:260] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:54.905980 19818 ts_tablet_manager.cc:1428] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 18:56:54.906062 19794 heartbeater.cc:503] Master 127.23.226.254:37163 was elected leader, sending a full tablet report...
W20260811 18:56:54.984189 19613 tablet.cc:2369] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:56:55.020682 19820 raft_consensus.cc:482] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:55.020823 19820 raft_consensus.cc:504] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:55.021229 19820 leader_election.cc:288] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1fcde89d654a30a46f68000c355e88 (127.23.226.194:39335), 1cd9d861c2444f528b74dcd770482cc3 (127.23.226.195:45473)
I20260811 18:56:55.024549 19809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:55.021485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:58317 (local address 127.23.226.194:39335)
0811 18:56:55.021540 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:55.021543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:55.021581 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:56:55.021689 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:55.021691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:55.021703 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:55.021785 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:55.022008 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.022664 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.023773 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.024151 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.024207 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:55.024214 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:55.024403 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 18:56:55.024450 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:56:55.024534 19401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:55.021423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39335 (local address 127.23.226.193:58317)
0811 18:56:55.021509 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:55.021523 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:55.021602 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:55.021820 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:55.021821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:55.021824 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:55.021921 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:55.021924 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.022750 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.022752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:55.023657 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:55.023660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.024235 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.024236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:55.024320 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:55.024325 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:56:55.024388 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 18:56:55.024437 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 18:56:55.024683 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:55.021579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:58219 (local address 127.23.226.195:45473)
0811 18:56:55.021632 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:55.021635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:55.021796 (+ 161us) server_negotiation.cc:407] Connection header received
0811 18:56:55.021838 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:55.021839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:55.021851 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:55.021946 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:55.022123 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.022747 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.023773 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.024270 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.024352 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:55.024362 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:55.024554 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 18:56:55.024601 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:56:55.024972 19530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "196a28f0d52542e8a1f42648d79c82b4" candidate_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1fcde89d654a30a46f68000c355e88" is_pre_election: true
I20260811 18:56:55.025185 19530 raft_consensus.cc:2454] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ebd25cf5d64581ae15f59c9aafe7c6 in term 0.
I20260811 18:56:55.025408 19827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:55.021480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:45473 (local address 127.23.226.193:58219)
0811 18:56:55.021682 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:55.021692 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:55.021767 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:55.021952 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:55.021953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:55.021955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:55.022043 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:55.022045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.022836 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.022836 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:55.023660 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:55.023663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.024378 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.024379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:55.024467 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:55.024470 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:56:55.024531 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 18:56:55.024571 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":114,"threads_started":1}
I20260811 18:56:55.025465 19229 leader_election.cc:302] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ebd25cf5d64581ae15f59c9aafe7c6, cb1fcde89d654a30a46f68000c355e88; no voters:
I20260811 18:56:55.025593 19820 raft_consensus.cc:2781] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:56:55.025645 19820 raft_consensus.cc:482] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:56:55.025682 19820 raft_consensus.cc:3037] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:55.025805 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "196a28f0d52542e8a1f42648d79c82b4" candidate_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cd9d861c2444f528b74dcd770482cc3" is_pre_election: true
I20260811 18:56:55.025931 19734 raft_consensus.cc:2454] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ebd25cf5d64581ae15f59c9aafe7c6 in term 0.
I20260811 18:56:55.026553 19820 raft_consensus.cc:504] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:55.026701 19820 leader_election.cc:288] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [CANDIDATE]: Term 1 election: Requested vote from peers cb1fcde89d654a30a46f68000c355e88 (127.23.226.194:39335), 1cd9d861c2444f528b74dcd770482cc3 (127.23.226.195:45473)
I20260811 18:56:55.026836 19530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "196a28f0d52542e8a1f42648d79c82b4" candidate_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1fcde89d654a30a46f68000c355e88"
I20260811 18:56:55.026882 19734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "196a28f0d52542e8a1f42648d79c82b4" candidate_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cd9d861c2444f528b74dcd770482cc3"
I20260811 18:56:55.026948 19734 raft_consensus.cc:3037] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:55.026933 19530 raft_consensus.cc:3037] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:55.027714 19734 raft_consensus.cc:2454] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ebd25cf5d64581ae15f59c9aafe7c6 in term 1.
I20260811 18:56:55.027868 19530 raft_consensus.cc:2454] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ebd25cf5d64581ae15f59c9aafe7c6 in term 1.
I20260811 18:56:55.027889 19227 leader_election.cc:302] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cd9d861c2444f528b74dcd770482cc3, 45ebd25cf5d64581ae15f59c9aafe7c6; no voters:
I20260811 18:56:55.027985 19820 raft_consensus.cc:2781] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:55.028162 19820 raft_consensus.cc:686] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [term 1 LEADER]: Becoming Leader. State: Replica: 45ebd25cf5d64581ae15f59c9aafe7c6, State: Running, Role: LEADER
I20260811 18:56:55.028282 19820 consensus_queue.cc:237] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } }
I20260811 18:56:55.029275 19114 catalog_manager.cc:5495] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ebd25cf5d64581ae15f59c9aafe7c6 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ebd25cf5d64581ae15f59c9aafe7c6" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 34249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260811 18:56:55.034140 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:55.031870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53242 (local address 127.23.226.193:34249)
0811 18:56:55.031933 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:55.031935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:55.031944 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:56:55.031980 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:55.031981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:55.032011 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:55.032079 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:56:55.032177 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.032660 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.033363 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:55.033587 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:55.033646 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:55.033788 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:56:55.033884 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:56:55.033949 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:55.034035 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 18:56:55.034053 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:56:55.036018 19734 raft_consensus.cc:1261] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 1 FOLLOWER]: Refusing update from remote peer 45ebd25cf5d64581ae15f59c9aafe7c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:55.036048 19530 raft_consensus.cc:1261] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 1 FOLLOWER]: Refusing update from remote peer 45ebd25cf5d64581ae15f59c9aafe7c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:55.036435 19820 consensus_queue.cc:1035] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1fcde89d654a30a46f68000c355e88" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:55.036598 19828 consensus_queue.cc:1035] T 196a28f0d52542e8a1f42648d79c82b4 P 45ebd25cf5d64581ae15f59c9aafe7c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cd9d861c2444f528b74dcd770482cc3" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:55.039675 19835 mvcc.cc:205] Tried to move back new op lower bound from 7317400023185051648 to 7317400023156543488. Current Snapshot: MvccSnapshot[applied={T|T < 7317400023185051648}]
I20260811 18:56:55.039983 19834 mvcc.cc:205] Tried to move back new op lower bound from 7317400023185051648 to 7317400023156543488. Current Snapshot: MvccSnapshot[applied={T|T < 7317400023185051648 or (T in {7317400023185051648})}]
I20260811 18:56:55.041981 19113 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:55.042092 19113 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:55.043005 19113 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1415e2caf3c0439fa0cf700bbbb734d3: Sending DeleteTablet for 3 replicas of tablet 196a28f0d52542e8a1f42648d79c82b4
I20260811 18:56:55.043442 19703 tablet_service.cc:1514] Processing DeleteTablet for tablet 196a28f0d52542e8a1f42648d79c82b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:55 UTC) from {username='slave'} at 127.0.0.1:40628
I20260811 18:56:55.043457 19498 tablet_service.cc:1514] Processing DeleteTablet for tablet 196a28f0d52542e8a1f42648d79c82b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:55 UTC) from {username='slave'} at 127.0.0.1:51990
I20260811 18:56:55.043674 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 19206
I20260811 18:56:55.043718 19844 tablet_replica.cc:330] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: stopping tablet replica
I20260811 18:56:55.043812 19844 raft_consensus.cc:2229] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:55.043905 19844 raft_consensus.cc:2258] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:55.044365 19844 ts_tablet_manager.cc:1905] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:55.046657 19844 ts_tablet_manager.cc:1918] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:55.046729 19844 log.cc:1196] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/196a28f0d52542e8a1f42648d79c82b4
I20260811 18:56:55.046984 19844 ts_tablet_manager.cc:1939] T 196a28f0d52542e8a1f42648d79c82b4 P 1cd9d861c2444f528b74dcd770482cc3: Deleting consensus metadata
I20260811 18:56:55.049922 19096 catalog_manager.cc:4841] TS 1cd9d861c2444f528b74dcd770482cc3 (127.23.226.195:45473): tablet 196a28f0d52542e8a1f42648d79c82b4 (table test-table [id=874d1dd118334c92bc94ef1d50c332ef]) successfully deleted
I20260811 18:56:55.051565 19845 tablet_replica.cc:330] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: stopping tablet replica
I20260811 18:56:55.051714 19845 raft_consensus.cc:2229] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:55.051855 19845 raft_consensus.cc:2258] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:55.052289 19845 ts_tablet_manager.cc:1905] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:55.053753 19845 ts_tablet_manager.cc:1918] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:55.053848 19845 log.cc:1196] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/196a28f0d52542e8a1f42648d79c82b4
I20260811 18:56:55.054085 19845 ts_tablet_manager.cc:1939] T 196a28f0d52542e8a1f42648d79c82b4 P cb1fcde89d654a30a46f68000c355e88: Deleting consensus metadata
I20260811 18:56:55.054566 19100 catalog_manager.cc:4841] TS cb1fcde89d654a30a46f68000c355e88 (127.23.226.194:39335): tablet 196a28f0d52542e8a1f42648d79c82b4 (table test-table [id=874d1dd118334c92bc94ef1d50c332ef]) successfully deleted
W20260811 18:56:55.056634 19098 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:34249 (error 108)
I20260811 18:56:55.057260 19807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:55.057073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:34249 (local address 127.0.0.1:53256)
0811 18:56:55.057136 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:55.057218 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:34249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 18:56:55.057299 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 19402
W20260811 18:56:55.057421 19098 catalog_manager.cc:4584] TS 45ebd25cf5d64581ae15f59c9aafe7c6 (127.23.226.193:34249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 196a28f0d52542e8a1f42648d79c82b4: Network error: Client connection negotiation failed: client connection to 127.23.226.193:34249: connect: Connection refused (error 111)
I20260811 18:56:55.083534 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 19616
I20260811 18:56:55.094676 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 19076
2026-08-11T18:56:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (854 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:56:55 dist-test-slave-68xk krb5kdc[19849](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:56:55 dist-test-slave-68xk krb5kdc[19849](info): set up 2 sockets
Aug 11 18:56:55 dist-test-slave-68xk krb5kdc[19849](info): commencing operation
krb5kdc: starting...
W20260811 18:56:56.363178 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:56:56 dist-test-slave-68xk krb5kdc[19849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:56:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:56:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:56:56.507375 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37257
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:38303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:37257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:56.591604 19873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:56.591821 19873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:56.591845 19873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:56.592990 19873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:56.593034 19873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:56.593048 19873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:56.593060 19873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:56.593115 19873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:56.594645 19873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:38303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:37257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:56.594897 19873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:56.595136 19873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:56.600049 19884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:56.600106 19873 server_base.cc:1034] running on GCE node
W20260811 18:56:56.600085 19880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:56.600273 19879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:56.600548 19873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:56.600800 19873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:56.601972 19873 hybrid_clock.cc:648] HybridClock initialized: now 1786474616601960 us; error 30 us; skew 500 ppm
Aug 11 18:56:56 dist-test-slave-68xk krb5kdc[19849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474616, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:56.604651 19873 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:56:56.605141 19873 webserver.cc:460] Webserver started at http://127.23.226.254:41697/ using document root <none> and password file <none>
I20260811 18:56:56.605373 19873 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:56.605440 19873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:56.605593 19873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:56.606706 19873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "b71bec7383ca489e8929d816cd7ab677"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "136d117d206488b5025ab89408d37421"
server_key_iv: "7ee69454551b1f2a5f0a41093850ab37"
server_key_version: "encryptionkey@0"
I20260811 18:56:56.607077 19873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "b71bec7383ca489e8929d816cd7ab677"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "136d117d206488b5025ab89408d37421"
server_key_iv: "7ee69454551b1f2a5f0a41093850ab37"
server_key_version: "encryptionkey@0"
I20260811 18:56:56.608413 19873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:56:56.609133 19892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:56.609323 19873 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:56:56.609429 19873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "b71bec7383ca489e8929d816cd7ab677"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "136d117d206488b5025ab89408d37421"
server_key_iv: "7ee69454551b1f2a5f0a41093850ab37"
server_key_version: "encryptionkey@0"
I20260811 18:56:56.609504 19873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:56.620859 19873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:56.623284 19873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:56.623451 19873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:56.627924 19873 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:37257
I20260811 18:56:56.627991 19981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:37257 every 8 connection(s)
I20260811 18:56:56.628355 19873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:56.629288 19983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:56.631943 19983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677: Bootstrap starting.
I20260811 18:56:56.632606 19983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:56.632936 19983 log.cc:824] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:56.633244 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 19873
I20260811 18:56:56.633378 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:56:56.633584 24459 external_mini_cluster.cc:1428] Setting key 39473b570a4ea29f287092be22f95e0b
I20260811 18:56:56.633807 19983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677: No bootstrap required, opened a new log
I20260811 18:56:56.635721 19983 raft_consensus.cc:348] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71bec7383ca489e8929d816cd7ab677" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37257 } }
I20260811 18:56:56.635877 19983 raft_consensus.cc:374] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:56.635900 19983 raft_consensus.cc:729] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71bec7383ca489e8929d816cd7ab677, State: Initialized, Role: FOLLOWER
I20260811 18:56:56.636062 19983 consensus_queue.cc:260] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71bec7383ca489e8929d816cd7ab677" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37257 } }
I20260811 18:56:56.636165 19983 raft_consensus.cc:388] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:56.636214 19983 raft_consensus.cc:482] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:56.636262 19983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:56.637163 19983 raft_consensus.cc:504] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71bec7383ca489e8929d816cd7ab677" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37257 } }
I20260811 18:56:56.637290 19983 leader_election.cc:302] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b71bec7383ca489e8929d816cd7ab677; no voters:
I20260811 18:56:56.637449 19983 leader_election.cc:288] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:56:56.637487 19989 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:56.637616 19989 raft_consensus.cc:686] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [term 1 LEADER]: Becoming Leader. State: Replica: b71bec7383ca489e8929d816cd7ab677, State: Running, Role: LEADER
I20260811 18:56:56.637717 19983 sys_catalog.cc:564] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:56.637708 19989 consensus_queue.cc:237] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71bec7383ca489e8929d816cd7ab677" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37257 } }
I20260811 18:56:56.639123 19990 sys_catalog.cc:455] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b71bec7383ca489e8929d816cd7ab677. Latest consensus state: current_term: 1 leader_uuid: "b71bec7383ca489e8929d816cd7ab677" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71bec7383ca489e8929d816cd7ab677" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37257 } } }
I20260811 18:56:56.639202 19990 sys_catalog.cc:458] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:56.639631 20006 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:56.639721 19991 sys_catalog.cc:455] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b71bec7383ca489e8929d816cd7ab677" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b71bec7383ca489e8929d816cd7ab677" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37257 } } }
I20260811 18:56:56.639794 19991 sys_catalog.cc:458] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:56.640245 20006 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 18:56:56 dist-test-slave-68xk krb5kdc[19849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:56.642581 20006 catalog_manager.cc:1347] Generated new cluster ID: 4e67123e44fd4fd2b878023904da6cc4
I20260811 18:56:56.642638 20006 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:56:56.649962 19988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:56.634156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56676 (local address 127.23.226.254:37257)
0811 18:56:56.634373 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:56.634383 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:56.634441 (+ 58us) server_negotiation.cc:407] Connection header received
0811 18:56:56.635712 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:56.635719 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:56.635771 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:56.635930 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:56.636785 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:56.638152 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:56.639360 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:56.639974 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:56.640116 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:56.643133 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:56.643137 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:56.643138 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:56.643151 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:56.648164 (+ 5013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:56.648598 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:56.648602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:56.648602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:56.648723 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:56.648962 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:56.648963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:56.648963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:56.649250 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:56.649436 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:56.649549 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 18:56:56.649702 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":93,"threads_started":1}
I20260811 18:56:56.660230 20006 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:56:56.660778 20006 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:56.673609 20006 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677: Generated new TSK 0
I20260811 18:56:56.673875 20006 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:56:56.709836 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37257
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:38303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:56.811447 20017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:56.811671 20017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:56.811699 20017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:56.813400 20017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:56.813454 20017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:56.813485 20017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:56:56.815219 20017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:38303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:56.815487 20017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:56.815747 20017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:56.821393 20025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:56.821412 20027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:56.821426 20024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:56.821815 20017 server_base.cc:1034] running on GCE node
I20260811 18:56:56.822041 20017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:56.822314 20017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:56.823460 20017 hybrid_clock.cc:648] HybridClock initialized: now 1786474616823425 us; error 54 us; skew 500 ppm
Aug 11 18:56:56 dist-test-slave-68xk krb5kdc[19849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474616, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:56.826093 20017 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:56:56.826659 20017 webserver.cc:460] Webserver started at http://127.23.226.193:41567/ using document root <none> and password file <none>
I20260811 18:56:56.826891 20017 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:56.826960 20017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:56.827118 20017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:56.828155 20017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "831112a6f45d438f8c179c813d28c741"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "fd494a98c7b31192404bf5a0888b1f1e"
server_key_iv: "c2a718b9eef0861b5b88020eed33bd85"
server_key_version: "encryptionkey@0"
I20260811 18:56:56.828532 20017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "831112a6f45d438f8c179c813d28c741"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "fd494a98c7b31192404bf5a0888b1f1e"
server_key_iv: "c2a718b9eef0861b5b88020eed33bd85"
server_key_version: "encryptionkey@0"
I20260811 18:56:56.829922 20017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:56:56.830883 20035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:56.831081 20017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:56.831183 20017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "831112a6f45d438f8c179c813d28c741"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "fd494a98c7b31192404bf5a0888b1f1e"
server_key_iv: "c2a718b9eef0861b5b88020eed33bd85"
server_key_version: "encryptionkey@0"
I20260811 18:56:56.831296 20017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:56.842811 20017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:56.845084 20017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:56.845245 20017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:56.845475 20017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:56.845801 20017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:56.845856 20017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:56.845897 20017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:56.845925 20017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:56.852288 20017 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:37421
I20260811 18:56:56.852351 20204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:37421 every 8 connection(s)
I20260811 18:56:56.852686 20017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:56:56.856781 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 20017
I20260811 18:56:56.856936 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:56:56.857179 24459 external_mini_cluster.cc:1428] Setting key d76360b2ed993bb86a61df8aa2a13534
Aug 11 18:56:56 dist-test-slave-68xk krb5kdc[19849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474616, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:56.863346 19988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:56.853449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:49139 (local address 127.23.226.254:37257)
0811 18:56:56.853527 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:56.853529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:56.853742 (+ 213us) server_negotiation.cc:407] Connection header received
0811 18:56:56.854324 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:56.854326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:56.854344 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:56.854429 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:56.855470 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:56.856040 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:56.857260 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:56.857567 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:56.857639 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:56.860099 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:56.860101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:56.860102 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:56.860114 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:56.861720 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:56.862177 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:56.862179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:56.862180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:56.862252 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:56.862612 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:56.862613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:56.862613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:56.862739 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:56.862823 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:56.863134 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 18:56:56.863238 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:56:56.863562 20209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:56.853428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37257 (local address 127.23.226.193:49139)
0811 18:56:56.853601 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:56.853639 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:56.854202 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:56.854496 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:56.854503 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:56.855144 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:56.855351 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:56.855356 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:56.856151 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:56.856152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:56.857142 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:56.857145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:56.857647 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:56.857649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:56.857804 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:56.858493 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:56.858510 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:56.859989 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:56.861834 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:56.861843 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:56.861845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:56.862090 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:56.862336 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:56.862337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:56.862337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:56.862529 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:56.862827 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:56.862836 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:56.862984 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 18:56:56.863092 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 18:56:56.863266 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260811 18:56:56.864113 20205 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37257
I20260811 18:56:56.864203 20205 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:56.864418 20205 heartbeater.cc:511] Master 127.23.226.254:37257 requested a full tablet report, sending...
I20260811 18:56:56.865072 19926 ts_manager.cc:194] Registered new tserver with Master: 831112a6f45d438f8c179c813d28c741 (127.23.226.193:37421)
I20260811 18:56:56.866124 19926 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:49139
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:56:56.887985 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37257
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:38303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:56.973429 20215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:56.973629 20215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:56.973654 20215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:56.974798 20215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:56.974839 20215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:56.974865 20215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:56:56.976310 20215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:38303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:56.976495 20215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:56.976668 20215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:56.981777 20221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:56.981787 20222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:56.982121 20215 server_base.cc:1034] running on GCE node
W20260811 18:56:56.981873 20225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:56.982456 20215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:56.982748 20215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:56.983896 20215 hybrid_clock.cc:648] HybridClock initialized: now 1786474616983887 us; error 36 us; skew 500 ppm
Aug 11 18:56:56 dist-test-slave-68xk krb5kdc[19849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474616, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:56.996794 20215 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:56:56.997292 20215 webserver.cc:460] Webserver started at http://127.23.226.194:41565/ using document root <none> and password file <none>
I20260811 18:56:56.997489 20215 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:56.997530 20215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:56.997624 20215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:56.998803 20215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "4436eb29ea7349d9999287b85fc5988c"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "ba2e92c877ede46174c13eb86c098429"
server_key_iv: "bfa4aac9c33683164cb4ab9e0bcde748"
server_key_version: "encryptionkey@0"
I20260811 18:56:56.999133 20215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "4436eb29ea7349d9999287b85fc5988c"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "ba2e92c877ede46174c13eb86c098429"
server_key_iv: "bfa4aac9c33683164cb4ab9e0bcde748"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.000504 20215 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:56:57.001237 20233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.001441 20215 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:57.001531 20215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "4436eb29ea7349d9999287b85fc5988c"
format_stamp: "Formatted at 2026-08-11 18:56:56 on dist-test-slave-68xk"
server_key: "ba2e92c877ede46174c13eb86c098429"
server_key_iv: "bfa4aac9c33683164cb4ab9e0bcde748"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.001590 20215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:57.016873 20215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:57.019294 20215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:57.019460 20215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:57.019718 20215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:57.020066 20215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:57.020123 20215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.020172 20215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:57.020201 20215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.026340 20215 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:44087
I20260811 18:56:57.026479 20409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:44087 every 8 connection(s)
I20260811 18:56:57.026777 20215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
Aug 11 18:56:57 dist-test-slave-68xk krb5kdc[19849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474616, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:57.034080 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 20215
I20260811 18:56:57.034204 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:56:57.034457 24459 external_mini_cluster.cc:1428] Setting key 9004b8e25dc7ce4b5eeb14924623ae03
I20260811 18:56:57.036361 19988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.027661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:53783 (local address 127.23.226.254:37257)
0811 18:56:57.027742 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.027744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.027923 (+ 179us) server_negotiation.cc:407] Connection header received
0811 18:56:57.028398 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.028399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.028409 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.028463 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:57.029374 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.029881 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.030921 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.031110 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.031164 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.033194 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:57.033196 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:57.033197 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:57.033205 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:57.034917 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:57.035365 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:57.035367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:57.035367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:57.035426 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:57.035689 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:57.035690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:57.035691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:57.035810 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:57.035885 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.036162 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.036264 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:56:57.036574 20415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.027608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37257 (local address 127.23.226.194:53783)
0811 18:56:57.027806 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.027842 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:57.028316 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:57.028515 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:57.028518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:57.029081 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:57.029287 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.029291 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.029964 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.029965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.030846 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.030848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.031226 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.031227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.031330 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.031748 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:57.031756 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:57.033093 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:57.035008 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:57.035054 (+ 46us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:57.035057 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:57.035281 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:57.035501 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:57.035502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:57.035502 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:57.035612 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:57.035877 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:57.035884 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:57.036022 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 18:56:57.036141 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 18:56:57.036330 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260811 18:56:57.037120 20412 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37257
I20260811 18:56:57.037227 20412 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:57.037441 20412 heartbeater.cc:511] Master 127.23.226.254:37257 requested a full tablet report, sending...
I20260811 18:56:57.037851 19926 ts_manager.cc:194] Registered new tserver with Master: 4436eb29ea7349d9999287b85fc5988c (127.23.226.194:44087)
I20260811 18:56:57.038275 19926 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:53783
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:56:57.062652 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37257
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:38303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:57.146788 20419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:57.146994 20419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:57.147018 20419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:57.148103 20419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:57.148138 20419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:57.148170 20419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:56:57.149629 20419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:38303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:37257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:57.149825 20419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:57.150089 20419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:57.155416 20427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:57.155414 20433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:57.155444 20430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:57.155737 20419 server_base.cc:1034] running on GCE node
I20260811 18:56:57.156015 20419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:57.156231 20419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:57.157380 20419 hybrid_clock.cc:648] HybridClock initialized: now 1786474617157370 us; error 34 us; skew 500 ppm
Aug 11 18:56:57 dist-test-slave-68xk krb5kdc[19849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474617, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:57.160298 20419 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:56:57.160780 20419 webserver.cc:460] Webserver started at http://127.23.226.195:39131/ using document root <none> and password file <none>
I20260811 18:56:57.161039 20419 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:57.161089 20419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:57.161234 20419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:57.162333 20419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "3931a902b06d4a1a96493b90d6e10f42"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "6737864921b6507fb33a366a6a8c97df"
server_key_iv: "0ac416f79f49cef578d5d5a5e7ee12f4"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.162796 20419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "3931a902b06d4a1a96493b90d6e10f42"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "6737864921b6507fb33a366a6a8c97df"
server_key_iv: "0ac416f79f49cef578d5d5a5e7ee12f4"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.164237 20419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:57.165071 20444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.165320 20419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:57.165424 20419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "3931a902b06d4a1a96493b90d6e10f42"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "6737864921b6507fb33a366a6a8c97df"
server_key_iv: "0ac416f79f49cef578d5d5a5e7ee12f4"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.165503 20419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:57.175450 20419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:57.177759 20419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:57.177965 20419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:57.178244 20419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:57.178710 20419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:57.178787 20419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.178834 20419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:57.178864 20419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.185737 20419 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:46355
I20260811 18:56:57.185793 20617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:46355 every 8 connection(s)
I20260811 18:56:57.186144 20419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:56:57.188345 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 20419
I20260811 18:56:57.188433 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:56:57.188637 24459 external_mini_cluster.cc:1428] Setting key 4d1dac630b9c7a5599101c4040a6bdf5
Aug 11 18:56:57 dist-test-slave-68xk krb5kdc[19849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474617, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:57.196781 19988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.186967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:39079 (local address 127.23.226.254:37257)
0811 18:56:57.187035 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.187037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.187273 (+ 236us) server_negotiation.cc:407] Connection header received
0811 18:56:57.187867 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.187869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.187885 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.187943 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:57.189185 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.189754 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.190951 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.191192 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.191289 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.193586 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:57.193588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:57.193589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:57.193597 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:57.195179 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:57.195628 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:57.195629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:57.195630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:57.195698 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:57.196007 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:57.196008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:57.196009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:57.196143 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:57.196226 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.196543 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.196629 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:56:57.197024 20627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.186953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:37257 (local address 127.23.226.195:39079)
0811 18:56:57.187136 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.187177 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:57.187738 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:57.188016 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:57.188021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:57.188862 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:57.189076 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.189082 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.189865 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.189866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.190853 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.190855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.191304 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.191305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.191440 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.191934 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:56:57.191944 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:57.193472 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:57.195281 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:57.195290 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:57.195293 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:57.195538 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:57.195806 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:56:57.195807 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:56:57.195807 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:56:57.195927 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:56:57.196229 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:57.196237 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:57.196389 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 18:56:57.196503 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 18:56:57.196675 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260811 18:56:57.197638 20622 heartbeater.cc:347] Connected to a master server at 127.23.226.254:37257
I20260811 18:56:57.197765 20622 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:57.197963 20622 heartbeater.cc:511] Master 127.23.226.254:37257 requested a full tablet report, sending...
I20260811 18:56:57.198544 19926 ts_manager.cc:194] Registered new tserver with Master: 3931a902b06d4a1a96493b90d6e10f42 (127.23.226.195:46355)
I20260811 18:56:57.198997 19926 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:39079
I20260811 18:56:57.200552 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:56:57.209074 19988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.202002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56684 (local address 127.23.226.254:37257)
0811 18:56:57.202079 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.202081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.202176 (+ 95us) server_negotiation.cc:407] Connection header received
0811 18:56:57.202224 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.202225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.202234 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.202297 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:57.202976 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.203471 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.204400 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.204582 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.204685 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.206289 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:57.206290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:57.206291 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:57.206297 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:57.207680 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:57.208123 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:57.208125 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:57.208125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:57.208229 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:57.208487 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:57.208488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:57.208488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:57.208648 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:57.208749 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.208892 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.208951 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 18:56:57.210938 19926 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:56:57.212565 19926 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:56:57.219981 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.215560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44798 (local address 127.23.226.194:44087)
0811 18:56:57.215774 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.215779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.215791 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:56:57.215920 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.215922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.215940 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.216013 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:57.216287 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.217120 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.218672 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.219480 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.219571 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.219627 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.219853 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.219900 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260811 18:56:57.219983 20640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.215410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:44087 (local address 127.0.0.1:44798)
0811 18:56:57.215642 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.215686 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:57.215789 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:57.216111 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:57.216114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:57.216117 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:57.216186 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.216188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.217274 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.217276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.218575 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.218578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.219595 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.219596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.219695 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.219710 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 18:56:57.219791 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 18:56:57.219887 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":35,"thread_start_us":88,"threads_started":1}
I20260811 18:56:57.220091 20644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.215926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58864 (local address 127.23.226.193:37421)
0811 18:56:57.216152 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.216158 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.216169 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:56:57.216214 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.216217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.216234 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.216318 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:57.216574 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.217806 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.218993 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.219501 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.219598 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.219658 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.219938 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.219988 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":92,"threads_started":1}
I20260811 18:56:57.220732 20643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.215670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:37421 (local address 127.0.0.1:58864)
0811 18:56:57.215858 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.215868 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:57.215913 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:57.216403 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:57.216404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:57.216406 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:57.216468 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.216470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.217939 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.217940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.218900 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.218903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.219693 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.219694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.219744 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.219748 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:56:57.219795 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 18:56:57.219869 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":82,"threads_started":1}
I20260811 18:56:57.221081 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.215466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:46355 (local address 127.0.0.1:33874)
0811 18:56:57.215815 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.215829 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:57.216117 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:57.216490 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:57.216491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:57.216494 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:57.216534 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.216536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.218470 (+ 1934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.218471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.219686 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.219690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.220840 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.220842 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.220906 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.220910 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:56:57.220971 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 18:56:57.221018 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":99,"threads_started":1}
I20260811 18:56:57.221150 20642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.215605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33874 (local address 127.23.226.195:46355)
0811 18:56:57.216035 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.216039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.216050 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:56:57.216362 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.216366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.216386 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.216475 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:57.216602 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.217819 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.219792 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.220725 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.220845 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.220915 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.220987 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.221042 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":115,"threads_started":1}
I20260811 18:56:57.221565 20314 tablet_service.cc:1467] Processing CreateTablet for tablet 8073f72135c149b88462d933f903f85b (DEFAULT_TABLE table=test-table [id=6103f10b39254a348956f8c412b32438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:57.221686 20106 tablet_service.cc:1467] Processing CreateTablet for tablet 8073f72135c149b88462d933f903f85b (DEFAULT_TABLE table=test-table [id=6103f10b39254a348956f8c412b32438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:57.221823 20511 tablet_service.cc:1467] Processing CreateTablet for tablet 8073f72135c149b88462d933f903f85b (DEFAULT_TABLE table=test-table [id=6103f10b39254a348956f8c412b32438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:57.221953 20314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8073f72135c149b88462d933f903f85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:57.221976 20106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8073f72135c149b88462d933f903f85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:57.222123 20511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8073f72135c149b88462d933f903f85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:57.225066 20645 tablet_bootstrap.cc:492] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741: Bootstrap starting.
I20260811 18:56:57.225528 20647 tablet_bootstrap.cc:492] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Bootstrap starting.
I20260811 18:56:57.225842 20645 tablet_bootstrap.cc:654] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:57.225935 20646 tablet_bootstrap.cc:492] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Bootstrap starting.
I20260811 18:56:57.226189 20647 tablet_bootstrap.cc:654] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:57.226599 20645 log.cc:824] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:57.226720 20646 tablet_bootstrap.cc:654] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:57.226801 20647 log.cc:824] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:57.227385 20646 log.cc:824] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:57.227747 20645 tablet_bootstrap.cc:492] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741: No bootstrap required, opened a new log
I20260811 18:56:57.227833 20645 ts_tablet_manager.cc:1397] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:56:57.227815 20647 tablet_bootstrap.cc:492] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: No bootstrap required, opened a new log
I20260811 18:56:57.227911 20647 ts_tablet_manager.cc:1397] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 18:56:57.228358 20646 tablet_bootstrap.cc:492] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: No bootstrap required, opened a new log
I20260811 18:56:57.228441 20646 ts_tablet_manager.cc:1397] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:56:57.229322 20645 raft_consensus.cc:348] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.229496 20645 raft_consensus.cc:374] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:57.229542 20645 raft_consensus.cc:729] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831112a6f45d438f8c179c813d28c741, State: Initialized, Role: FOLLOWER
I20260811 18:56:57.229655 20645 consensus_queue.cc:260] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.229976 20645 ts_tablet_manager.cc:1428] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:56:57.229987 20205 heartbeater.cc:503] Master 127.23.226.254:37257 was elected leader, sending a full tablet report...
I20260811 18:56:57.230125 20647 raft_consensus.cc:348] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.230326 20647 raft_consensus.cc:374] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:57.230377 20647 raft_consensus.cc:729] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3931a902b06d4a1a96493b90d6e10f42, State: Initialized, Role: FOLLOWER
I20260811 18:56:57.230536 20647 consensus_queue.cc:260] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.230849 20647 ts_tablet_manager.cc:1428] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 18:56:57.230859 20622 heartbeater.cc:503] Master 127.23.226.254:37257 was elected leader, sending a full tablet report...
I20260811 18:56:57.230819 20646 raft_consensus.cc:348] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.231010 20646 raft_consensus.cc:374] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:57.231056 20646 raft_consensus.cc:729] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4436eb29ea7349d9999287b85fc5988c, State: Initialized, Role: FOLLOWER
I20260811 18:56:57.231539 20646 consensus_queue.cc:260] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.231890 20646 ts_tablet_manager.cc:1428] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260811 18:56:57.232038 20412 heartbeater.cc:503] Master 127.23.226.254:37257 was elected leader, sending a full tablet report...
W20260811 18:56:57.277397 20413 tablet.cc:2369] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:56:57.353473 20206 tablet.cc:2369] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 18:56:57.436867 20625 tablet.cc:2369] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:56:57.446465 20654 raft_consensus.cc:482] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:57.446597 20654 raft_consensus.cc:504] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.446993 20654 leader_election.cc:288] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 831112a6f45d438f8c179c813d28c741 (127.23.226.193:37421), 3931a902b06d4a1a96493b90d6e10f42 (127.23.226.195:46355)
I20260811 18:56:57.450522 20415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.447246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:37421 (local address 127.23.226.194:36403)
0811 18:56:57.447322 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.447337 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:57.447393 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:57.447661 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:57.447663 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:57.447665 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:57.447758 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.447760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.448590 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.448592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.449519 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.449522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.450189 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.450191 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.450289 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.450294 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:56:57.450367 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 18:56:57.450445 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":1}
I20260811 18:56:57.450562 20644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.447348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:36403 (local address 127.23.226.193:37421)
0811 18:56:57.447416 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.447419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.447451 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:56:57.447486 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.447487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.447502 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.447566 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:57.447884 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.448471 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.449618 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.450094 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.450154 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.450161 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.450391 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.450460 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:56:57.450707 20642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.447321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:55979 (local address 127.23.226.195:46355)
0811 18:56:57.447378 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.447380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.447637 (+ 257us) server_negotiation.cc:407] Connection header received
0811 18:56:57.447671 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.447672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.447683 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.447759 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:57.448138 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.448774 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.449788 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.450297 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.450378 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.450387 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.450591 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.450639 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:56:57.450932 20655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.447258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:46355 (local address 127.23.226.194:55979)
0811 18:56:57.447466 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.447478 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:57.447549 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:57.447922 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:57.447923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:57.447926 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:57.448003 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.448005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.448872 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.448873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.449690 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.449692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.450396 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.450398 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.450492 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.450496 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:56:57.450579 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:56:57.450852 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":144,"threads_started":1}
I20260811 18:56:57.450970 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8073f72135c149b88462d933f903f85b" candidate_uuid: "4436eb29ea7349d9999287b85fc5988c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831112a6f45d438f8c179c813d28c741" is_pre_election: true
I20260811 18:56:57.451220 20138 raft_consensus.cc:2454] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4436eb29ea7349d9999287b85fc5988c in term 0.
I20260811 18:56:57.451309 20542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8073f72135c149b88462d933f903f85b" candidate_uuid: "4436eb29ea7349d9999287b85fc5988c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3931a902b06d4a1a96493b90d6e10f42" is_pre_election: true
I20260811 18:56:57.451457 20542 raft_consensus.cc:2454] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4436eb29ea7349d9999287b85fc5988c in term 0.
I20260811 18:56:57.451575 20234 leader_election.cc:302] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4436eb29ea7349d9999287b85fc5988c, 831112a6f45d438f8c179c813d28c741; no voters:
I20260811 18:56:57.451751 20654 raft_consensus.cc:2781] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:56:57.451813 20654 raft_consensus.cc:482] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:56:57.451851 20654 raft_consensus.cc:3037] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:57.452705 20654 raft_consensus.cc:504] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.452888 20654 leader_election.cc:288] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [CANDIDATE]: Term 1 election: Requested vote from peers 831112a6f45d438f8c179c813d28c741 (127.23.226.193:37421), 3931a902b06d4a1a96493b90d6e10f42 (127.23.226.195:46355)
I20260811 18:56:57.453100 20542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8073f72135c149b88462d933f903f85b" candidate_uuid: "4436eb29ea7349d9999287b85fc5988c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3931a902b06d4a1a96493b90d6e10f42"
I20260811 18:56:57.453197 20542 raft_consensus.cc:3037] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:57.453181 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8073f72135c149b88462d933f903f85b" candidate_uuid: "4436eb29ea7349d9999287b85fc5988c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "831112a6f45d438f8c179c813d28c741"
I20260811 18:56:57.453305 20138 raft_consensus.cc:3037] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:57.454074 20542 raft_consensus.cc:2454] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4436eb29ea7349d9999287b85fc5988c in term 1.
I20260811 18:56:57.454123 20138 raft_consensus.cc:2454] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4436eb29ea7349d9999287b85fc5988c in term 1.
I20260811 18:56:57.454311 20240 leader_election.cc:302] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3931a902b06d4a1a96493b90d6e10f42, 4436eb29ea7349d9999287b85fc5988c; no voters:
I20260811 18:56:57.454447 20654 raft_consensus.cc:2781] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:57.454669 20654 raft_consensus.cc:686] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 1 LEADER]: Becoming Leader. State: Replica: 4436eb29ea7349d9999287b85fc5988c, State: Running, Role: LEADER
I20260811 18:56:57.454792 20654 consensus_queue.cc:237] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } }
I20260811 18:56:57.455824 19923 catalog_manager.cc:5495] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4436eb29ea7349d9999287b85fc5988c (127.23.226.194). New cstate: current_term: 1 leader_uuid: "4436eb29ea7349d9999287b85fc5988c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4436eb29ea7349d9999287b85fc5988c" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 44087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 } health_report { overall_health: UNKNOWN } } }
I20260811 18:56:57.503515 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.500733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44800 (local address 127.23.226.194:44087)
0811 18:56:57.500801 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.500804 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.500817 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:56:57.500935 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.500936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.500970 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.501066 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:56:57.501248 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.501831 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.502744 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.502948 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.503015 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.503183 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:56:57.503272 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:56:57.503347 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.503425 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.503437 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:56:57.505746 20542 raft_consensus.cc:1261] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 1 FOLLOWER]: Refusing update from remote peer 4436eb29ea7349d9999287b85fc5988c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:57.506161 20138 raft_consensus.cc:1261] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 1 FOLLOWER]: Refusing update from remote peer 4436eb29ea7349d9999287b85fc5988c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:57.506165 20654 consensus_queue.cc:1035] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3931a902b06d4a1a96493b90d6e10f42" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 46355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:57.506470 20654 consensus_queue.cc:1035] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [LEADER]: Connected to new peer: Peer: permanent_uuid: "831112a6f45d438f8c179c813d28c741" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:57.509110 20664 mvcc.cc:205] Tried to move back new op lower bound from 7317400033300189184 to 7317400033095471104. Current Snapshot: MvccSnapshot[applied={T|T < 7317400033300189184}]
I20260811 18:56:57.510038 20661 mvcc.cc:205] Tried to move back new op lower bound from 7317400033300189184 to 7317400033095471104. Current Snapshot: MvccSnapshot[applied={T|T < 7317400033300189184}]
I20260811 18:56:57.511402 19923 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:57.511495 19923 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:57.512230 19923 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b71bec7383ca489e8929d816cd7ab677: Sending DeleteTablet for 3 replicas of tablet 8073f72135c149b88462d933f903f85b
I20260811 18:56:57.512617 20314 tablet_service.cc:1514] Processing DeleteTablet for tablet 8073f72135c149b88462d933f903f85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:57 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:44798
I20260811 18:56:57.512617 20511 tablet_service.cc:1514] Processing DeleteTablet for tablet 8073f72135c149b88462d933f903f85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:57 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:33874
I20260811 18:56:57.512624 20106 tablet_service.cc:1514] Processing DeleteTablet for tablet 8073f72135c149b88462d933f903f85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:57 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:58864
I20260811 18:56:57.512883 20677 tablet_replica.cc:330] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741: stopping tablet replica
I20260811 18:56:57.513002 20677 raft_consensus.cc:2229] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:57.513130 20677 raft_consensus.cc:2258] T 8073f72135c149b88462d933f903f85b P 831112a6f45d438f8c179c813d28c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:57.513147 20676 tablet_replica.cc:330] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: stopping tablet replica
I20260811 18:56:57.513230 20676 raft_consensus.cc:2229] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:57.513257 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 20017
I20260811 18:56:57.513319 20676 raft_consensus.cc:2258] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:57.513456 20675 tablet_replica.cc:330] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: stopping tablet replica
I20260811 18:56:57.513532 20675 raft_consensus.cc:2229] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:56:57.513617 20675 raft_consensus.cc:2258] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:57.531644 20675 ts_tablet_manager.cc:1905] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:57.531644 20676 ts_tablet_manager.cc:1905] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:57.533687 20676 ts_tablet_manager.cc:1918] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:57.533687 20675 ts_tablet_manager.cc:1918] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:57.533782 20675 log.cc:1196] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/8073f72135c149b88462d933f903f85b
I20260811 18:56:57.533783 20676 log.cc:1196] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/8073f72135c149b88462d933f903f85b
I20260811 18:56:57.534068 20676 ts_tablet_manager.cc:1939] T 8073f72135c149b88462d933f903f85b P 3931a902b06d4a1a96493b90d6e10f42: Deleting consensus metadata
I20260811 18:56:57.534077 20675 ts_tablet_manager.cc:1939] T 8073f72135c149b88462d933f903f85b P 4436eb29ea7349d9999287b85fc5988c: Deleting consensus metadata
I20260811 18:56:57.534551 19900 catalog_manager.cc:4841] TS 3931a902b06d4a1a96493b90d6e10f42 (127.23.226.195:46355): tablet 8073f72135c149b88462d933f903f85b (table test-table [id=6103f10b39254a348956f8c412b32438]) successfully deleted
I20260811 18:56:57.534698 19895 catalog_manager.cc:4841] TS 4436eb29ea7349d9999287b85fc5988c (127.23.226.194:44087): tablet 8073f72135c149b88462d933f903f85b (table test-table [id=6103f10b39254a348956f8c412b32438]) successfully deleted
W20260811 18:56:57.539551 19895 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:37421 (error 108)
I20260811 18:56:57.539816 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 20215
I20260811 18:56:57.544607 20640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.539956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:37421 (local address 127.0.0.1:58872)
0811 18:56:57.544526 (+ 4570us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.544572 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:37421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4545}
W20260811 18:56:57.553802 19895 catalog_manager.cc:4584] TS 831112a6f45d438f8c179c813d28c741 (127.23.226.193:37421): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8073f72135c149b88462d933f903f85b: Network error: Client connection negotiation failed: client connection to 127.23.226.193:37421: connect: Connection refused (error 111)
I20260811 18:56:57.558394 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 20419
I20260811 18:56:57.571827 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 19873
2026-08-11T18:56:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2473 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T18:56:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:56:57Z Disabled control of system clock
I20260811 18:56:57.606922 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:44337
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:44337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:56:57.689850 20687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:57.690064 20687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:57.690085 20687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:57.691355 20687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:57.691402 20687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:57.691416 20687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:57.691428 20687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:57.691440 20687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:57.692786 20687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:44337
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:44337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:57.693045 20687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:57.693352 20687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:57.698685 20696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:57.698727 20697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:57.698686 20700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:57.698980 20687 server_base.cc:1034] running on GCE node
I20260811 18:56:57.699220 20687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:57.699496 20687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:57.700667 20687 hybrid_clock.cc:648] HybridClock initialized: now 1786474617700639 us; error 32 us; skew 500 ppm
I20260811 18:56:57.702059 20687 webserver.cc:460] Webserver started at http://127.23.226.254:42705/ using document root <none> and password file <none>
I20260811 18:56:57.702353 20687 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:57.702405 20687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:57.702637 20687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:57.703895 20687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "10a577a9ba1142f091afac4e4aedb449"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "388b89821dc63e0c4b3f5f183884dc2f"
server_key_iv: "74d084496d47bbe4e32e081d62714786"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.704300 20687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "10a577a9ba1142f091afac4e4aedb449"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "388b89821dc63e0c4b3f5f183884dc2f"
server_key_iv: "74d084496d47bbe4e32e081d62714786"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.705785 20687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:56:57.706669 20710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.706852 20687 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:57.706959 20687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "10a577a9ba1142f091afac4e4aedb449"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "388b89821dc63e0c4b3f5f183884dc2f"
server_key_iv: "74d084496d47bbe4e32e081d62714786"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.707055 20687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:57.718235 20687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:57.718598 20687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:57.718765 20687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:57.722872 20687 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:44337
I20260811 18:56:57.722920 20780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:44337 every 8 connection(s)
I20260811 18:56:57.723285 20687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:57.724361 20781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:57.726775 20781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449: Bootstrap starting.
I20260811 18:56:57.727370 20781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:57.727682 20781 log.cc:824] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:57.728428 20781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449: No bootstrap required, opened a new log
I20260811 18:56:57.730139 20781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a577a9ba1142f091afac4e4aedb449" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44337 } }
I20260811 18:56:57.730286 20781 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:57.730311 20781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a577a9ba1142f091afac4e4aedb449, State: Initialized, Role: FOLLOWER
I20260811 18:56:57.730492 20781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a577a9ba1142f091afac4e4aedb449" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44337 } }
I20260811 18:56:57.730585 20781 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:57.730610 20781 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:57.730667 20781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:57.731230 20781 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a577a9ba1142f091afac4e4aedb449" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44337 } }
I20260811 18:56:57.731348 20781 leader_election.cc:302] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10a577a9ba1142f091afac4e4aedb449; no voters:
I20260811 18:56:57.731560 20781 leader_election.cc:288] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:56:57.731680 20786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:57.731804 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 20687
I20260811 18:56:57.731858 20781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:57.731878 20786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [term 1 LEADER]: Becoming Leader. State: Replica: 10a577a9ba1142f091afac4e4aedb449, State: Running, Role: LEADER
I20260811 18:56:57.731947 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:56:57.731997 20786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a577a9ba1142f091afac4e4aedb449" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44337 } }
I20260811 18:56:57.732206 24459 external_mini_cluster.cc:1428] Setting key 12a1a3a837ec14266115753212aef605
I20260811 18:56:57.732381 20786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10a577a9ba1142f091afac4e4aedb449. Latest consensus state: current_term: 1 leader_uuid: "10a577a9ba1142f091afac4e4aedb449" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a577a9ba1142f091afac4e4aedb449" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44337 } } }
I20260811 18:56:57.732511 20788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10a577a9ba1142f091afac4e4aedb449" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a577a9ba1142f091afac4e4aedb449" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 44337 } } }
I20260811 18:56:57.733225 20786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:57.733269 20788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:57.733758 20812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:57.734496 20812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:56:57.736896 20812 catalog_manager.cc:1347] Generated new cluster ID: b90d8eb13ced4d539ac3cf548b100bf4
I20260811 18:56:57.736959 20812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:56:57.739239 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.732988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49262 (local address 127.23.226.254:44337)
0811 18:56:57.733757 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.733767 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.733804 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:56:57.733949 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.733957 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.734036 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.734160 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:57.734506 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.735867 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.736832 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.737479 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.737616 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.738436 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:57.738441 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:57.738441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:57.738685 (+ 244us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:57.738735 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:57.738751 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:57.738824 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.738922 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.739004 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":395,"threads_started":1}
I20260811 18:56:57.752281 20812 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:56:57.752959 20812 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:57.761865 20812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449: Generated new TSK 0
I20260811 18:56:57.762072 20812 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:56:57.763932 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44337
--builtin_ntp_servers=127.23.226.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:56:57.848646 20819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:57.848850 20819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:57.848872 20819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:57.850021 20819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:57.850064 20819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:57.850090 20819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:56:57.851517 20819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:57.851778 20819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:57.852124 20819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:57.857265 20832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:57.857260 20828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:57.857260 20829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:57.857760 20819 server_base.cc:1034] running on GCE node
I20260811 18:56:57.857988 20819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:57.858235 20819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:57.859400 20819 hybrid_clock.cc:648] HybridClock initialized: now 1786474617859364 us; error 51 us; skew 500 ppm
I20260811 18:56:57.860831 20819 webserver.cc:460] Webserver started at http://127.23.226.193:32781/ using document root <none> and password file <none>
I20260811 18:56:57.861123 20819 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:57.861194 20819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:57.861341 20819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:57.862398 20819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "9548507e38e14952b2202737314682b3"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "5b34d37742faf61831400d6658cbf980"
server_key_iv: "9fdceb60b9edd051747c232c0265cb13"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.862843 20819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "9548507e38e14952b2202737314682b3"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "5b34d37742faf61831400d6658cbf980"
server_key_iv: "9fdceb60b9edd051747c232c0265cb13"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.864214 20819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:57.864986 20845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.865188 20819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:57.865295 20819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "9548507e38e14952b2202737314682b3"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "5b34d37742faf61831400d6658cbf980"
server_key_iv: "9fdceb60b9edd051747c232c0265cb13"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.865384 20819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:57.885527 20819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:57.885891 20819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:57.886057 20819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:57.886310 20819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:57.886725 20819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:57.886786 20819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.886822 20819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:57.886873 20819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:57.893079 20819 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:36187
I20260811 18:56:57.893133 21017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:36187 every 8 connection(s)
I20260811 18:56:57.893476 20819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:56:57.898744 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.894233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:47067 (local address 127.23.226.254:44337)
0811 18:56:57.894310 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:57.894313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:57.894649 (+ 336us) server_negotiation.cc:407] Connection header received
0811 18:56:57.895231 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:57.895232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:57.895244 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:57.895302 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:57.895956 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.896457 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.897406 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.897587 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.897647 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.898479 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:57.898480 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:57.898481 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:57.898486 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:57.898502 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:57.898507 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:57.898561 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:57.898656 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 18:56:57.898683 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 18:56:57.898975 21020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:57.894227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44337 (local address 127.23.226.193:47067)
0811 18:56:57.894492 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:57.894539 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:57.895127 (+ 588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:57.895358 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:57.895361 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:57.895369 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:57.895871 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.895874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.896545 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.896546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.897332 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:57.897335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:57.897675 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:57.897675 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:57.897790 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:57.898310 (+ 520us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:56:57.898310 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:57.898338 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:56:57.898361 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:57.898576 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:57.898582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:57.898584 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:56:57.898641 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 18:56:57.898721 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":116,"threads_started":1}
I20260811 18:56:57.899555 21018 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44337
I20260811 18:56:57.899667 21018 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:57.899852 21018 heartbeater.cc:511] Master 127.23.226.254:44337 requested a full tablet report, sending...
I20260811 18:56:57.900323 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 20819
I20260811 18:56:57.900416 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:56:57.900520 20736 ts_manager.cc:194] Registered new tserver with Master: 9548507e38e14952b2202737314682b3 (127.23.226.193:36187)
I20260811 18:56:57.900669 24459 external_mini_cluster.cc:1428] Setting key 711ef95d68d0dc321b6a274c72e1d3aa
I20260811 18:56:57.901288 20736 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.193:47067
I20260811 18:56:57.901810 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44337
--builtin_ntp_servers=127.23.226.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:56:57.984859 21021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:57.985081 21021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:57.985105 21021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:57.986299 21021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:57.986342 21021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:57.986367 21021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:56:57.987753 21021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:57.988003 21021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:57.988307 21021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:57.993458 21028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:57.993474 21032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:57.993477 21029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:57.993754 21021 server_base.cc:1034] running on GCE node
I20260811 18:56:57.993934 21021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:57.994138 21021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:57.995292 21021 hybrid_clock.cc:648] HybridClock initialized: now 1786474617995280 us; error 28 us; skew 500 ppm
I20260811 18:56:57.996645 21021 webserver.cc:460] Webserver started at http://127.23.226.194:37899/ using document root <none> and password file <none>
I20260811 18:56:57.996922 21021 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:57.996976 21021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:57.997138 21021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:57.998248 21021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "54d9b5631e2444d58349fbeece013e10"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "a1f19f928c0789ab51ca83a32b144809"
server_key_iv: "79ac8df6a71586dff4981279a0df05df"
server_key_version: "encryptionkey@0"
I20260811 18:56:57.998679 21021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "54d9b5631e2444d58349fbeece013e10"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "a1f19f928c0789ab51ca83a32b144809"
server_key_iv: "79ac8df6a71586dff4981279a0df05df"
server_key_version: "encryptionkey@0"
I20260811 18:56:58.000015 21021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:58.000808 21044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:58.001044 21021 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:58.001122 21021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "54d9b5631e2444d58349fbeece013e10"
format_stamp: "Formatted at 2026-08-11 18:56:57 on dist-test-slave-68xk"
server_key: "a1f19f928c0789ab51ca83a32b144809"
server_key_iv: "79ac8df6a71586dff4981279a0df05df"
server_key_version: "encryptionkey@0"
I20260811 18:56:58.001210 21021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:58.029846 21021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:58.030165 21021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:58.030318 21021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:58.030588 21021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:58.030941 21021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:58.030975 21021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:58.030998 21021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:58.031044 21021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:58.037189 21021 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:40857
I20260811 18:56:58.037277 21228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:40857 every 8 connection(s)
I20260811 18:56:58.037599 21021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:56:58.043124 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.038392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:41991 (local address 127.23.226.254:44337)
0811 18:56:58.038498 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.038501 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.038726 (+ 225us) server_negotiation.cc:407] Connection header received
0811 18:56:58.039347 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.039349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.039363 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.039409 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:58.040124 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.040631 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.041621 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.041824 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.041901 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.042818 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:58.042820 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:58.042820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:58.042825 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:58.042841 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:58.042845 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:58.042912 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.043010 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.043043 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 18:56:58.043331 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.038372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44337 (local address 127.23.226.194:41991)
0811 18:56:58.038601 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:58.038636 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:58.039220 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:58.039489 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:58.039493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:58.039505 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:58.040007 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.040012 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.040735 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.040736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.041519 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.041521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.041913 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.041914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.042056 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.042654 (+ 598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:56:58.042655 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:58.042684 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:56:58.042706 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:58.042912 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:58.042919 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:58.042922 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:56:58.043011 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 18:56:58.043114 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":114,"threads_started":1}
I20260811 18:56:58.043850 21229 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44337
I20260811 18:56:58.043964 21229 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:58.044157 21229 heartbeater.cc:511] Master 127.23.226.254:44337 requested a full tablet report, sending...
I20260811 18:56:58.044582 20736 ts_manager.cc:194] Registered new tserver with Master: 54d9b5631e2444d58349fbeece013e10 (127.23.226.194:40857)
I20260811 18:56:58.044967 20736 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.194:41991
I20260811 18:56:58.047602 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 21021
I20260811 18:56:58.047694 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:56:58.047861 24459 external_mini_cluster.cc:1428] Setting key 8bdbb5b8a62da3817be0a989013e6223
I20260811 18:56:58.048789 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44337
--builtin_ntp_servers=127.23.226.212:36407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:56:58.133366 21234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:58.133608 21234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:58.133647 21234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:58.134881 21234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:58.134941 21234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:58.134980 21234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:56:58.136353 21234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:44337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:58.136632 21234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:58.136951 21234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:58.141994 21250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:58.141994 21247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:58.142025 21246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:58.142428 21234 server_base.cc:1034] running on GCE node
I20260811 18:56:58.142637 21234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:58.142836 21234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:58.143980 21234 hybrid_clock.cc:648] HybridClock initialized: now 1786474618143942 us; error 50 us; skew 500 ppm
I20260811 18:56:58.145241 21234 webserver.cc:460] Webserver started at http://127.23.226.195:39981/ using document root <none> and password file <none>
I20260811 18:56:58.145498 21234 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:58.145566 21234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:58.145716 21234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:58.146850 21234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "bf99848974ef4678a4d2615c6b549c62"
format_stamp: "Formatted at 2026-08-11 18:56:58 on dist-test-slave-68xk"
server_key: "116e7a0825cc0cfbc15629dc303df41d"
server_key_iv: "5fff534c7b52858372f7b1022d6e8e18"
server_key_version: "encryptionkey@0"
I20260811 18:56:58.147203 21234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "bf99848974ef4678a4d2615c6b549c62"
format_stamp: "Formatted at 2026-08-11 18:56:58 on dist-test-slave-68xk"
server_key: "116e7a0825cc0cfbc15629dc303df41d"
server_key_iv: "5fff534c7b52858372f7b1022d6e8e18"
server_key_version: "encryptionkey@0"
I20260811 18:56:58.148562 21234 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:56:58.149358 21259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:58.149550 21234 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:56:58.149657 21234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "bf99848974ef4678a4d2615c6b549c62"
format_stamp: "Formatted at 2026-08-11 18:56:58 on dist-test-slave-68xk"
server_key: "116e7a0825cc0cfbc15629dc303df41d"
server_key_iv: "5fff534c7b52858372f7b1022d6e8e18"
server_key_version: "encryptionkey@0"
I20260811 18:56:58.149732 21234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:58.164471 21234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:58.164800 21234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:58.164956 21234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:58.165210 21234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:56:58.165553 21234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:56:58.165609 21234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:58.165647 21234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:56:58.165695 21234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:58.171892 21234 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:37377
I20260811 18:56:58.171947 21446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:37377 every 8 connection(s)
I20260811 18:56:58.172287 21234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:56:58.174520 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 21234
I20260811 18:56:58.174657 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:56:58.174861 24459 external_mini_cluster.cc:1428] Setting key 3b4450220fe626d1eb7c03f61a17de37
I20260811 18:56:58.178617 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.173057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:52441 (local address 127.23.226.254:44337)
0811 18:56:58.173130 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.173132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.173362 (+ 230us) server_negotiation.cc:407] Connection header received
0811 18:56:58.173913 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.173915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.173929 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.173984 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:58.174808 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.175515 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.176915 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.177113 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.177195 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.178248 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:58.178249 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:58.178249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:58.178254 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:58.178270 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:58.178275 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:58.178337 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.178503 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.178539 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:56:58.178874 21449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.173028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:44337 (local address 127.23.226.195:52441)
0811 18:56:58.173227 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:58.173267 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:58.173797 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:58.174055 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:58.174059 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:58.174069 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:56:58.174718 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.174725 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.175638 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.175639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.176613 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.176617 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.177222 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.177223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.177354 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.178025 (+ 671us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:56:58.178026 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:56:58.178104 (+ 78us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:56:58.178131 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:56:58.178373 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:56:58.178380 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:56:58.178383 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:56:58.178485 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 18:56:58.178595 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
I20260811 18:56:58.179454 21447 heartbeater.cc:347] Connected to a master server at 127.23.226.254:44337
I20260811 18:56:58.179572 21447 heartbeater.cc:464] Registering TS with master...
I20260811 18:56:58.179771 21447 heartbeater.cc:511] Master 127.23.226.254:44337 requested a full tablet report, sending...
I20260811 18:56:58.180204 20736 ts_manager.cc:194] Registered new tserver with Master: bf99848974ef4678a4d2615c6b549c62 (127.23.226.195:37377)
I20260811 18:56:58.180619 20736 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.195:52441
I20260811 18:56:58.187007 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:56:58.191431 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.188528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49270 (local address 127.23.226.254:44337)
0811 18:56:58.188596 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.188599 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.188716 (+ 117us) server_negotiation.cc:407] Connection header received
0811 18:56:58.188770 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.188771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.188782 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.188831 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:58.188964 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.189442 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.190177 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.190373 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.190469 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.191130 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:58.191131 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:58.191132 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:56:58.191136 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:58.191150 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:56:58.191154 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:58.191234 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.191300 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.191310 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:56:58.193136 20736 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:56:58.194695 20736 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:56:58.201550 21464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.197265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54186 (local address 127.23.226.195:37377)
0811 18:56:58.197715 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.197720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.197728 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:56:58.197811 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.197813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.197831 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.197925 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:58.198050 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.199137 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.200667 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.201155 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.201257 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.201351 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.201427 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.201465 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":93,"threads_started":1}
I20260811 18:56:58.201537 21463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.196998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:37377 (local address 127.0.0.1:54186)
0811 18:56:58.197496 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:58.197509 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:58.197569 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:58.197919 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:58.197920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:58.197922 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:58.197964 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.197965 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.199225 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.199226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.200560 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.200563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.201247 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.201248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.201324 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.201336 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 18:56:58.201414 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 18:56:58.201465 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"mutex_wait_us":69,"thread_start_us":187,"threads_started":1}
I20260811 18:56:58.202102 21466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.197336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47692 (local address 127.23.226.194:40857)
0811 18:56:58.197541 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.197546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.197555 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:56:58.197598 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.197599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.197611 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.197706 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:58.197894 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.199093 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.200586 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.201421 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.201506 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.201776 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.201975 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.202022 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":115,"threads_started":1}
I20260811 18:56:58.202109 21459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.196926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:40857 (local address 127.0.0.1:47692)
0811 18:56:58.197195 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:58.197237 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:58.197316 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:58.197722 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:58.197725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:58.197728 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:58.197799 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.197801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.199196 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.199197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.200481 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.200484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.201809 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.201810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.201882 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.201886 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:56:58.201956 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:56:58.202000 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":33,"thread_start_us":69,"threads_started":1}
I20260811 18:56:58.202448 21469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.197343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58252 (local address 127.23.226.193:36187)
0811 18:56:58.197848 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.197852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.198174 (+ 322us) server_negotiation.cc:407] Connection header received
0811 18:56:58.198226 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.198229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.198253 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.198350 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:58.198496 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.199390 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.200642 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.201420 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.201506 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.201599 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.202288 (+ 689us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.202337 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":120,"threads_started":1}
I20260811 18:56:58.202298 21339 tablet_service.cc:1467] Processing CreateTablet for tablet 21729b9b9e65414ea3433c88aa740e38 (DEFAULT_TABLE table=test-table [id=1879065c34154740bb4c1ab2643b6982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:58.202111 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.197137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:36187 (local address 127.0.0.1:58252)
0811 18:56:58.198034 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:58.198046 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:58.198101 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:58.198347 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:58.198348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:58.198350 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:58.198395 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.198397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.199484 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.199485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.200566 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.200567 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.201828 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.201829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.201884 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.201886 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:56:58.201956 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 18:56:58.202000 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":878,"mutex_wait_us":4,"thread_start_us":102,"threads_started":1}
I20260811 18:56:58.202711 21339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21729b9b9e65414ea3433c88aa740e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:58.205933 21470 tablet_bootstrap.cc:492] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: Bootstrap starting.
I20260811 18:56:58.205900 20917 tablet_service.cc:1467] Processing CreateTablet for tablet 21729b9b9e65414ea3433c88aa740e38 (DEFAULT_TABLE table=test-table [id=1879065c34154740bb4c1ab2643b6982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:58.206012 21120 tablet_service.cc:1467] Processing CreateTablet for tablet 21729b9b9e65414ea3433c88aa740e38 (DEFAULT_TABLE table=test-table [id=1879065c34154740bb4c1ab2643b6982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:56:58.206264 20917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21729b9b9e65414ea3433c88aa740e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:58.206391 21120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21729b9b9e65414ea3433c88aa740e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:58.206712 21470 tablet_bootstrap.cc:654] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:58.207060 21470 log.cc:824] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:58.208007 21470 tablet_bootstrap.cc:492] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: No bootstrap required, opened a new log
I20260811 18:56:58.208096 21470 ts_tablet_manager.cc:1397] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:56:58.209424 21473 tablet_bootstrap.cc:492] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3: Bootstrap starting.
I20260811 18:56:58.209964 21474 tablet_bootstrap.cc:492] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Bootstrap starting.
I20260811 18:56:58.210278 21473 tablet_bootstrap.cc:654] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:58.210649 21474 tablet_bootstrap.cc:654] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:58.210703 21473 log.cc:824] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:58.210842 21470 raft_consensus.cc:348] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.211038 21470 raft_consensus.cc:374] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:58.211015 21474 log.cc:824] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:58.211103 21470 raft_consensus.cc:729] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf99848974ef4678a4d2615c6b549c62, State: Initialized, Role: FOLLOWER
I20260811 18:56:58.211253 21470 consensus_queue.cc:260] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.211550 21470 ts_tablet_manager.cc:1428] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 18:56:58.211565 21473 tablet_bootstrap.cc:492] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3: No bootstrap required, opened a new log
I20260811 18:56:58.211624 21473 ts_tablet_manager.cc:1397] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:56:58.211676 21447 heartbeater.cc:503] Master 127.23.226.254:44337 was elected leader, sending a full tablet report...
I20260811 18:56:58.211752 21474 tablet_bootstrap.cc:492] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: No bootstrap required, opened a new log
I20260811 18:56:58.211825 21474 ts_tablet_manager.cc:1397] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 18:56:58.214462 21474 raft_consensus.cc:348] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.214533 21473 raft_consensus.cc:348] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.214622 21474 raft_consensus.cc:374] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:58.214658 21473 raft_consensus.cc:374] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:58.214658 21474 raft_consensus.cc:729] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54d9b5631e2444d58349fbeece013e10, State: Initialized, Role: FOLLOWER
I20260811 18:56:58.214700 21473 raft_consensus.cc:729] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548507e38e14952b2202737314682b3, State: Initialized, Role: FOLLOWER
I20260811 18:56:58.214785 21474 consensus_queue.cc:260] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.214828 21473 consensus_queue.cc:260] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.215058 21473 ts_tablet_manager.cc:1428] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 18:56:58.215050 21474 ts_tablet_manager.cc:1428] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:56:58.215122 21229 heartbeater.cc:503] Master 127.23.226.254:44337 was elected leader, sending a full tablet report...
I20260811 18:56:58.215384 21018 heartbeater.cc:503] Master 127.23.226.254:44337 was elected leader, sending a full tablet report...
W20260811 18:56:58.288239 21231 tablet.cc:2369] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:56:58.291844 21478 raft_consensus.cc:482] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:56:58.292013 21478 raft_consensus.cc:504] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.292522 21478 leader_election.cc:288] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54d9b5631e2444d58349fbeece013e10 (127.23.226.194:40857), 9548507e38e14952b2202737314682b3 (127.23.226.193:36187)
I20260811 18:56:58.296649 21449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.292712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:40857 (local address 127.23.226.195:39317)
0811 18:56:58.292792 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:58.292806 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:58.292863 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:58.293050 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:58.293051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:58.293053 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:58.293132 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.293134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.294189 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.294190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.295510 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.295512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.296369 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.296370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.296447 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.296452 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:56:58.296511 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 18:56:58.296556 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":66}
I20260811 18:56:58.296667 21469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.292935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:54061 (local address 127.23.226.193:36187)
0811 18:56:58.292981 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.292984 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.293137 (+ 153us) server_negotiation.cc:407] Connection header received
0811 18:56:58.293191 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.293192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.293207 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.293272 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:58.293419 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.294198 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.295631 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.296277 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.296362 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.296370 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.296540 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.296592 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:56:58.296676 21466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.292784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:39317 (local address 127.23.226.194:40857)
0811 18:56:58.292840 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.292842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.292852 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:56:58.292957 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.292958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.292973 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.293047 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:56:58.293226 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.294102 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.295631 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.296267 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.296362 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.296370 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.296540 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.296612 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 18:56:58.296661 21483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.292864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:36187 (local address 127.23.226.195:54061)
0811 18:56:58.293053 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:58.293063 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:56:58.293115 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:56:58.293287 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:56:58.293288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:56:58.293289 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:56:58.293339 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.293340 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.294274 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.294275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.295508 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:56:58.295512 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.296370 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.296370 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:56:58.296447 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.296452 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 18:56:58.296511 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 18:56:58.296556 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":6,"thread_start_us":130,"threads_started":1}
I20260811 18:56:58.297034 21154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21729b9b9e65414ea3433c88aa740e38" candidate_uuid: "bf99848974ef4678a4d2615c6b549c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54d9b5631e2444d58349fbeece013e10" is_pre_election: true
I20260811 18:56:58.297294 21154 raft_consensus.cc:2454] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf99848974ef4678a4d2615c6b549c62 in term 0.
I20260811 18:56:58.297328 20954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21729b9b9e65414ea3433c88aa740e38" candidate_uuid: "bf99848974ef4678a4d2615c6b549c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548507e38e14952b2202737314682b3" is_pre_election: true
I20260811 18:56:58.297513 20954 raft_consensus.cc:2454] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf99848974ef4678a4d2615c6b549c62 in term 0.
I20260811 18:56:58.297595 21261 leader_election.cc:302] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54d9b5631e2444d58349fbeece013e10, bf99848974ef4678a4d2615c6b549c62; no voters:
I20260811 18:56:58.297734 21478 raft_consensus.cc:2781] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:56:58.297816 21478 raft_consensus.cc:482] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:56:58.297835 21478 raft_consensus.cc:3037] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:58.298830 21478 raft_consensus.cc:504] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.298991 21478 leader_election.cc:288] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [CANDIDATE]: Term 1 election: Requested vote from peers 54d9b5631e2444d58349fbeece013e10 (127.23.226.194:40857), 9548507e38e14952b2202737314682b3 (127.23.226.193:36187)
I20260811 18:56:58.299203 21154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21729b9b9e65414ea3433c88aa740e38" candidate_uuid: "bf99848974ef4678a4d2615c6b549c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54d9b5631e2444d58349fbeece013e10"
I20260811 18:56:58.299239 20954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21729b9b9e65414ea3433c88aa740e38" candidate_uuid: "bf99848974ef4678a4d2615c6b549c62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548507e38e14952b2202737314682b3"
I20260811 18:56:58.299291 21154 raft_consensus.cc:3037] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:58.299351 20954 raft_consensus.cc:3037] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:58.300072 21154 raft_consensus.cc:2454] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf99848974ef4678a4d2615c6b549c62 in term 1.
I20260811 18:56:58.300206 20954 raft_consensus.cc:2454] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf99848974ef4678a4d2615c6b549c62 in term 1.
I20260811 18:56:58.300257 21261 leader_election.cc:302] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54d9b5631e2444d58349fbeece013e10, bf99848974ef4678a4d2615c6b549c62; no voters:
I20260811 18:56:58.300341 21478 raft_consensus.cc:2781] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:58.300524 21478 raft_consensus.cc:686] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 1 LEADER]: Becoming Leader. State: Replica: bf99848974ef4678a4d2615c6b549c62, State: Running, Role: LEADER
I20260811 18:56:58.300650 21478 consensus_queue.cc:237] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } }
I20260811 18:56:58.301574 20736 catalog_manager.cc:5495] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf99848974ef4678a4d2615c6b549c62 (127.23.226.195). New cstate: current_term: 1 leader_uuid: "bf99848974ef4678a4d2615c6b549c62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf99848974ef4678a4d2615c6b549c62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 37377 } health_report { overall_health: HEALTHY } } }
I20260811 18:56:58.320770 21464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.318048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54202 (local address 127.23.226.195:37377)
0811 18:56:58.318118 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:58.318120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:58.318130 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:56:58.318196 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:58.318196 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:58.318216 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:58.318285 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:56:58.318538 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.319006 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.319919 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:58.320103 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:58.320158 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:58.320368 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:56:58.320457 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:56:58.320534 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:58.320670 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 18:56:58.320678 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:56:58.322793 20954 raft_consensus.cc:1261] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 1 FOLLOWER]: Refusing update from remote peer bf99848974ef4678a4d2615c6b549c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:58.322813 21154 raft_consensus.cc:1261] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 1 FOLLOWER]: Refusing update from remote peer bf99848974ef4678a4d2615c6b549c62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:56:58.323189 21478 consensus_queue.cc:1035] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548507e38e14952b2202737314682b3" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 36187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:58.323338 21484 consensus_queue.cc:1035] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54d9b5631e2444d58349fbeece013e10" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 40857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:56:58.326668 21491 mvcc.cc:205] Tried to move back new op lower bound from 7317400036647243776 to 7317400036560142336. Current Snapshot: MvccSnapshot[applied={T|T < 7317400036647243776 or (T in {7317400036647243776})}]
I20260811 18:56:58.327847 21492 mvcc.cc:205] Tried to move back new op lower bound from 7317400036647243776 to 7317400036560142336. Current Snapshot: MvccSnapshot[applied={T|T < 7317400036647243776 or (T in {7317400036647243776})}]
I20260811 18:56:58.328205 20736 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:58.328290 20736 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:56:58.329043 20736 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10a577a9ba1142f091afac4e4aedb449: Sending DeleteTablet for 3 replicas of tablet 21729b9b9e65414ea3433c88aa740e38
I20260811 18:56:58.329396 21339 tablet_service.cc:1514] Processing DeleteTablet for tablet 21729b9b9e65414ea3433c88aa740e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:58 UTC) from {username='slave'} at 127.0.0.1:54186
I20260811 18:56:58.329427 21120 tablet_service.cc:1514] Processing DeleteTablet for tablet 21729b9b9e65414ea3433c88aa740e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:58 UTC) from {username='slave'} at 127.0.0.1:47692
I20260811 18:56:58.329476 20917 tablet_service.cc:1514] Processing DeleteTablet for tablet 21729b9b9e65414ea3433c88aa740e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:56:58 UTC) from {username='slave'} at 127.0.0.1:58252
I20260811 18:56:58.329694 21507 tablet_replica.cc:330] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: stopping tablet replica
I20260811 18:56:58.329744 21509 tablet_replica.cc:330] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3: stopping tablet replica
I20260811 18:56:58.329845 21509 raft_consensus.cc:2229] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:58.329928 21507 raft_consensus.cc:2229] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:56:58.329955 21509 raft_consensus.cc:2258] T 21729b9b9e65414ea3433c88aa740e38 P 9548507e38e14952b2202737314682b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:58.330014 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 20819
I20260811 18:56:58.330090 21507 raft_consensus.cc:2258] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:58.330606 21507 ts_tablet_manager.cc:1905] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:58.332489 21507 ts_tablet_manager.cc:1918] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:58.332568 21507 log.cc:1196] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/21729b9b9e65414ea3433c88aa740e38
I20260811 18:56:58.332846 21507 ts_tablet_manager.cc:1939] T 21729b9b9e65414ea3433c88aa740e38 P 54d9b5631e2444d58349fbeece013e10: Deleting consensus metadata
I20260811 18:56:58.333371 20715 catalog_manager.cc:4841] TS 54d9b5631e2444d58349fbeece013e10 (127.23.226.194:40857): tablet 21729b9b9e65414ea3433c88aa740e38 (table test-table [id=1879065c34154740bb4c1ab2643b6982]) successfully deleted
I20260811 18:56:58.342599 21506 tablet_replica.cc:330] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: stopping tablet replica
I20260811 18:56:58.342751 21506 raft_consensus.cc:2229] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 1 LEADER]: Raft consensus shutting down.
I20260811 18:56:58.342870 21506 raft_consensus.cc:2258] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:56:58.343360 21506 ts_tablet_manager.cc:1905] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:56:58.345506 21506 ts_tablet_manager.cc:1918] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:56:58.345589 21506 log.cc:1196] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/21729b9b9e65414ea3433c88aa740e38
W20260811 18:56:58.345798 20715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:36187 (error 108)
I20260811 18:56:58.345881 21506 ts_tablet_manager.cc:1939] T 21729b9b9e65414ea3433c88aa740e38 P bf99848974ef4678a4d2615c6b549c62: Deleting consensus metadata
I20260811 18:56:58.346350 20712 catalog_manager.cc:4841] TS bf99848974ef4678a4d2615c6b549c62 (127.23.226.195:37377): tablet 21729b9b9e65414ea3433c88aa740e38 (table test-table [id=1879065c34154740bb4c1ab2643b6982]) successfully deleted
I20260811 18:56:58.346400 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 21021
I20260811 18:56:58.346604 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:58.346466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:36187 (local address 127.0.0.1:58262)
0811 18:56:58.346522 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 18:56:58.346562 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:36187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 18:56:58.348161 20715 catalog_manager.cc:4584] TS 9548507e38e14952b2202737314682b3 (127.23.226.193:36187): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 21729b9b9e65414ea3433c88aa740e38: Network error: Client connection negotiation failed: client connection to 127.23.226.193:36187: connect: Connection refused (error 111)
I20260811 18:56:58.365075 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 21234
I20260811 18:56:58.374692 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 20687
2026-08-11T18:56:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (807 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:56:58 dist-test-slave-68xk krb5kdc[21515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:56:58 dist-test-slave-68xk krb5kdc[21515](info): set up 2 sockets
Aug 11 18:56:58 dist-test-slave-68xk krb5kdc[21515](info): commencing operation
krb5kdc: starting...
W20260811 18:56:59.645905 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:56:59 dist-test-slave-68xk krb5kdc[21515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:56:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:56:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:56:59.785300 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:39559
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:39559
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:56:59.874611 21543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:56:59.874833 21543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:56:59.874871 21543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:56:59.876016 21543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:56:59.876083 21543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:56:59.876106 21543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:56:59.876128 21543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:56:59.876157 21543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:56:59.877645 21543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:39559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:39559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:56:59.877916 21543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:56:59.878144 21543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:56:59.883461 21552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:59.883482 21554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:56:59.883493 21551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:56:59.883703 21543 server_base.cc:1034] running on GCE node
I20260811 18:56:59.884034 21543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:56:59.884289 21543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:56:59.885480 21543 hybrid_clock.cc:648] HybridClock initialized: now 1786474619885443 us; error 57 us; skew 500 ppm
Aug 11 18:56:59 dist-test-slave-68xk krb5kdc[21515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474619, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:56:59.888453 21543 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:56:59.888955 21543 webserver.cc:460] Webserver started at http://127.23.226.254:38967/ using document root <none> and password file <none>
I20260811 18:56:59.889191 21543 fs_manager.cc:359] Metadata directory not provided
I20260811 18:56:59.889262 21543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:56:59.889417 21543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:56:59.890554 21543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "711759b1d5674b5babea877722191e77"
format_stamp: "Formatted at 2026-08-11 18:56:59 on dist-test-slave-68xk"
server_key: "2f9c5756cac4cec94d403aae5121e483"
server_key_iv: "75df593dc838b6162e05b64cf20bf811"
server_key_version: "encryptionkey@0"
I20260811 18:56:59.890938 21543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "711759b1d5674b5babea877722191e77"
format_stamp: "Formatted at 2026-08-11 18:56:59 on dist-test-slave-68xk"
server_key: "2f9c5756cac4cec94d403aae5121e483"
server_key_iv: "75df593dc838b6162e05b64cf20bf811"
server_key_version: "encryptionkey@0"
I20260811 18:56:59.892373 21543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 18:56:59.893195 21563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:56:59.893510 21543 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:56:59.893639 21543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "711759b1d5674b5babea877722191e77"
format_stamp: "Formatted at 2026-08-11 18:56:59 on dist-test-slave-68xk"
server_key: "2f9c5756cac4cec94d403aae5121e483"
server_key_iv: "75df593dc838b6162e05b64cf20bf811"
server_key_version: "encryptionkey@0"
I20260811 18:56:59.893718 21543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:56:59.903035 21543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:56:59.905391 21543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:56:59.905582 21543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:56:59.909873 21543 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:39559
I20260811 18:56:59.909904 21643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:39559 every 8 connection(s)
I20260811 18:56:59.910264 21543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:56:59.911057 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 21543
I20260811 18:56:59.911178 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:56:59.911392 24459 external_mini_cluster.cc:1428] Setting key 05b67d7ce0eee4e3676a10847b0bcea9
I20260811 18:56:59.911424 21644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:56:59.914839 21644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77: Bootstrap starting.
I20260811 18:56:59.915544 21644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77: Neither blocks nor log segments found. Creating new log.
I20260811 18:56:59.915894 21644 log.cc:824] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77: Log is configured to *not* fsync() on all Append() calls
I20260811 18:56:59.916633 21644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77: No bootstrap required, opened a new log
Aug 11 18:56:59 dist-test-slave-68xk krb5kdc[21515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:56:59.918761 21644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711759b1d5674b5babea877722191e77" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 39559 } }
I20260811 18:56:59.918942 21644 raft_consensus.cc:374] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:56:59.918982 21644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 711759b1d5674b5babea877722191e77, State: Initialized, Role: FOLLOWER
I20260811 18:56:59.919140 21644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711759b1d5674b5babea877722191e77" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 39559 } }
I20260811 18:56:59.919238 21644 raft_consensus.cc:388] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:56:59.919292 21644 raft_consensus.cc:482] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:56:59.919365 21644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:56:59.920053 21644 raft_consensus.cc:504] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711759b1d5674b5babea877722191e77" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 39559 } }
I20260811 18:56:59.920166 21644 leader_election.cc:302] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 711759b1d5674b5babea877722191e77; no voters:
I20260811 18:56:59.920374 21644 leader_election.cc:288] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:56:59.920403 21653 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:56:59.920511 21653 raft_consensus.cc:686] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [term 1 LEADER]: Becoming Leader. State: Replica: 711759b1d5674b5babea877722191e77, State: Running, Role: LEADER
I20260811 18:56:59.920606 21653 consensus_queue.cc:237] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711759b1d5674b5babea877722191e77" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 39559 } }
I20260811 18:56:59.920648 21644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:56:59.920948 21653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 711759b1d5674b5babea877722191e77. Latest consensus state: current_term: 1 leader_uuid: "711759b1d5674b5babea877722191e77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711759b1d5674b5babea877722191e77" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 39559 } } }
I20260811 18:56:59.921041 21653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:59.920958 21655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "711759b1d5674b5babea877722191e77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "711759b1d5674b5babea877722191e77" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 39559 } } }
I20260811 18:56:59.921255 21655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77 [sys.catalog]: This master's current role is: LEADER
I20260811 18:56:59.921252 21663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:56:59.921880 21663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:56:59.923365 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:56:59.911960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59442 (local address 127.23.226.254:39559)
0811 18:56:59.912178 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 18:56:59.912186 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:56:59.912211 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:56:59.912628 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:56:59.912636 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:56:59.912681 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:56:59.912792 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:56:59.913612 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:59.914634 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:59.915713 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:56:59.916276 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:56:59.916411 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:56:59.919134 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:56:59.919139 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:56:59.919139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:56:59.919150 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:56:59.921282 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:59.921714 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:59.921717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:59.921717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:59.921820 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:56:59.922051 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:56:59.922051 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:56:59.922052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:56:59.922350 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:56:59.922952 (+ 602us) server_negotiation.cc:1035] Waiting for connection context
0811 18:56:59.923026 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 18:56:59.923167 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":82,"threads_started":1}
I20260811 18:56:59.923851 21663 catalog_manager.cc:1347] Generated new cluster ID: aa5a8b47acca49c4a2d2da6869e2877b
I20260811 18:56:59.923909 21663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:56:59.930056 21663 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:56:59.930821 21663 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:56:59.938325 21663 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77: Generated new TSK 0
I20260811 18:56:59.938555 21663 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.23.226.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
Entry for principal kudu/127.23.226.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab.
I20260811 18:56:59.977221 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:39559
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:00.077455 21681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:00.077656 21681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:00.077680 21681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:00.078768 21681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:00.078804 21681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:00.078830 21681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:57:00.080291 21681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.193.keytab
--principal=kudu/127.23.226.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:00.080487 21681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:00.080667 21681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:00.086037 21687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.086088 21688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:00.086246 21681 server_base.cc:1034] running on GCE node
W20260811 18:57:00.086311 21692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:00.086592 21681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:00.086870 21681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:00.088020 21681 hybrid_clock.cc:648] HybridClock initialized: now 1786474620088010 us; error 34 us; skew 500 ppm
Aug 11 18:57:00 dist-test-slave-68xk krb5kdc[21515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:00.090656 21681 init.cc:377] Logged in from keytab as kudu/127.23.226.193@KRBTEST.COM (short username kudu)
I20260811 18:57:00.091154 21681 webserver.cc:460] Webserver started at http://127.23.226.193:33039/ using document root <none> and password file <none>
I20260811 18:57:00.091415 21681 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:00.091485 21681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:00.091639 21681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:00.092741 21681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "53301a2778b757838724f6d53b640474"
server_key_iv: "2b1535961b0c5133337b51c81bd9324d"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.093106 21681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "53301a2778b757838724f6d53b640474"
server_key_iv: "2b1535961b0c5133337b51c81bd9324d"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.094521 21681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:00.095289 21704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.095471 21681 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:00.095574 21681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "53301a2778b757838724f6d53b640474"
server_key_iv: "2b1535961b0c5133337b51c81bd9324d"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.095665 21681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:00.127245 21681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:00.129151 21681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:00.129328 21681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:00.129585 21681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:00.129951 21681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:00.130010 21681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.130046 21681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:00.130091 21681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.136518 21681 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:38913
I20260811 18:57:00.136579 21886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:38913 every 8 connection(s)
I20260811 18:57:00.136896 21681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
Aug 11 18:57:00 dist-test-slave-68xk krb5kdc[21515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.193@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:00.143970 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 21681
I20260811 18:57:00.144114 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:00.144353 24459 external_mini_cluster.cc:1428] Setting key 791a300d529d7da9ad0edcff114e2e5e
I20260811 18:57:00.146998 21893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.137693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:39559 (local address 127.23.226.193:53285)
0811 18:57:00.137868 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.137907 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.138435 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.138691 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.138695 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.139252 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:00.139445 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.139449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.140237 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.140238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.141045 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.141047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.141456 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.141457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.141556 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.142037 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:00.142045 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:00.143571 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:00.145603 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:00.145621 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:00.145623 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:00.145845 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:00.146079 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:00.146080 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:00.146080 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:00.146193 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:00.146506 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:00.146512 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:00.146640 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.146722 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.146841 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":108,"threads_started":1}
I20260811 18:57:00.147032 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.137734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:53285 (local address 127.23.226.254:39559)
0811 18:57:00.137819 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.137821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.138007 (+ 186us) server_negotiation.cc:407] Connection header received
0811 18:57:00.138542 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.138543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.138576 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.138632 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:00.139550 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.140142 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.141142 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.141374 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.141439 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.143674 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:00.143676 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:00.143676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:00.143683 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:00.145523 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:00.145924 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:00.145925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:00.145925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:00.146009 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:00.146260 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:00.146261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:00.146261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:00.146438 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:00.146503 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.146777 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.146893 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 18:57:00.148061 21887 heartbeater.cc:347] Connected to a master server at 127.23.226.254:39559
I20260811 18:57:00.148151 21887 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:00.148363 21887 heartbeater.cc:511] Master 127.23.226.254:39559 requested a full tablet report, sending...
I20260811 18:57:00.148952 21586 ts_manager.cc:194] Registered new tserver with Master: 0138a5b350484b6fa3e27f4dbd1bcf6a (127.23.226.193:38913)
I20260811 18:57:00.149562 21586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.193@KRBTEST.COM'} at 127.23.226.193:53285
WARNING: no policy specified for kudu/127.23.226.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
Entry for principal kudu/127.23.226.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab.
I20260811 18:57:00.173178 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:39559
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:00.256846 21897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:00.257052 21897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:00.257076 21897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:00.258266 21897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:00.258311 21897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:00.258337 21897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:57:00.259822 21897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.194.keytab
--principal=kudu/127.23.226.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:00.260056 21897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:00.260317 21897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:00.265801 21904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.265810 21906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.265818 21908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:00.266070 21897 server_base.cc:1034] running on GCE node
I20260811 18:57:00.266325 21897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:00.266609 21897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:00.267795 21897 hybrid_clock.cc:648] HybridClock initialized: now 1786474620267779 us; error 54 us; skew 500 ppm
Aug 11 18:57:00 dist-test-slave-68xk krb5kdc[21515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:00.270673 21897 init.cc:377] Logged in from keytab as kudu/127.23.226.194@KRBTEST.COM (short username kudu)
I20260811 18:57:00.271162 21897 webserver.cc:460] Webserver started at http://127.23.226.194:35649/ using document root <none> and password file <none>
I20260811 18:57:00.271413 21897 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:00.271488 21897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:00.271657 21897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:00.272838 21897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "7ef9e6ac49e1475fa1758437fd1b4305"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "3e874b09e6e6f214f054ca24936c2b87"
server_key_iv: "bb88ab6322ee7049d79ad3c61eef0768"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.273254 21897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "7ef9e6ac49e1475fa1758437fd1b4305"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "3e874b09e6e6f214f054ca24936c2b87"
server_key_iv: "bb88ab6322ee7049d79ad3c61eef0768"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.274734 21897 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:00.275607 21922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.275795 21897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:00.275911 21897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "7ef9e6ac49e1475fa1758437fd1b4305"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "3e874b09e6e6f214f054ca24936c2b87"
server_key_iv: "bb88ab6322ee7049d79ad3c61eef0768"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.275992 21897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:00.304296 21897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:00.306731 21897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:00.306915 21897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:00.307199 21897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:00.307560 21897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:00.307624 21897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.307672 21897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:00.307704 21897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.314926 21897 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:39331
I20260811 18:57:00.314987 22110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:39331 every 8 connection(s)
I20260811 18:57:00.315371 21897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:00.318898 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 21897
I20260811 18:57:00.319054 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:00.319265 24459 external_mini_cluster.cc:1428] Setting key 14ad6123ccccd83eda7ee00eb94601ad
Aug 11 18:57:00 dist-test-slave-68xk krb5kdc[21515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.194@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:00.327230 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.316240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:57607 (local address 127.23.226.254:39559)
0811 18:57:00.316335 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.316337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.316655 (+ 318us) server_negotiation.cc:407] Connection header received
0811 18:57:00.317245 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.317247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.317261 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.317325 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:00.318502 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.319139 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.320585 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.320822 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.320918 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.323808 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:00.323810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:00.323810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:00.323819 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:00.325635 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:00.326081 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:00.326083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:00.326083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:00.326154 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:00.326451 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:00.326452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:00.326452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:00.326617 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:00.326703 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.326990 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.327098 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 18:57:00.327260 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.316173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:39559 (local address 127.23.226.194:57607)
0811 18:57:00.316407 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.316449 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.317126 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.317415 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.317419 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.318114 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:00.318334 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.318341 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.319240 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.319242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.320468 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.320472 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.320931 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.320932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.321084 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.321861 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:00.321870 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:00.323703 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:00.325740 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:00.325748 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:00.325750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:00.325992 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:00.326235 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:00.326236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:00.326236 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:00.326357 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:00.326700 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:00.326707 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:00.326835 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.326939 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.327082 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":111,"threads_started":1}
I20260811 18:57:00.327843 22111 heartbeater.cc:347] Connected to a master server at 127.23.226.254:39559
I20260811 18:57:00.327970 22111 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:00.328157 22111 heartbeater.cc:511] Master 127.23.226.254:39559 requested a full tablet report, sending...
I20260811 18:57:00.328620 21586 ts_manager.cc:194] Registered new tserver with Master: 7ef9e6ac49e1475fa1758437fd1b4305 (127.23.226.194:39331)
I20260811 18:57:00.329169 21586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.194@KRBTEST.COM'} at 127.23.226.194:57607
WARNING: no policy specified for kudu/127.23.226.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
Entry for principal kudu/127.23.226.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab.
I20260811 18:57:00.350112 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:39559
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:00.435117 22122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:00.435322 22122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:00.435345 22122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:00.436486 22122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:00.436528 22122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:00.436554 22122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:57:00.437992 22122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.195.keytab
--principal=kudu/127.23.226.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:00.438247 22122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:00.438622 22122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:00.443547 22133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.443559 22137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.443569 22130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:00.443898 22122 server_base.cc:1034] running on GCE node
I20260811 18:57:00.444129 22122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:00.444357 22122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:00.445508 22122 hybrid_clock.cc:648] HybridClock initialized: now 1786474620445496 us; error 28 us; skew 500 ppm
Aug 11 18:57:00 dist-test-slave-68xk krb5kdc[21515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:00.448024 22122 init.cc:377] Logged in from keytab as kudu/127.23.226.195@KRBTEST.COM (short username kudu)
I20260811 18:57:00.448494 22122 webserver.cc:460] Webserver started at http://127.23.226.195:42439/ using document root <none> and password file <none>
I20260811 18:57:00.448731 22122 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:00.448802 22122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:00.448958 22122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:00.450008 22122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "4f5576ecb9584e61b45d172694eb5f62"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "85ed73af5bfb9adfa7cf9e83910e14b5"
server_key_iv: "0b1d077f2583f337855c202860cabd83"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.450389 22122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "4f5576ecb9584e61b45d172694eb5f62"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "85ed73af5bfb9adfa7cf9e83910e14b5"
server_key_iv: "0b1d077f2583f337855c202860cabd83"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.451764 22122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:00.452497 22150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.452693 22122 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:00.452805 22122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "4f5576ecb9584e61b45d172694eb5f62"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "85ed73af5bfb9adfa7cf9e83910e14b5"
server_key_iv: "0b1d077f2583f337855c202860cabd83"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.452888 22122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:00.476225 22122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:00.478341 22122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:00.478536 22122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:00.478811 22122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:00.479178 22122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:00.479291 22122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.479336 22122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:00.479364 22122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.485371 22122 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:32961
I20260811 18:57:00.485464 22330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:32961 every 8 connection(s)
I20260811 18:57:00.485785 22122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
Aug 11 18:57:00 dist-test-slave-68xk krb5kdc[21515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474620, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.195@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:00.494858 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.486474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:55819 (local address 127.23.226.254:39559)
0811 18:57:00.486542 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.486544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.486790 (+ 246us) server_negotiation.cc:407] Connection header received
0811 18:57:00.487295 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.487296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.487306 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.487357 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:00.488277 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.488769 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.489798 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.489986 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.490040 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.492231 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:00.492232 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:00.492233 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:00.492239 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:00.493561 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:00.493971 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:00.493972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:00.493972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:00.494022 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:00.494274 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:00.494274 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:00.494275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:00.494372 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:00.494472 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.494727 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.494790 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:57:00.495064 22338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.486469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:39559 (local address 127.23.226.195:55819)
0811 18:57:00.486667 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.486704 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.487195 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.487412 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.487415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.487993 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:00.488181 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.488186 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.488853 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.488854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.489717 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.489720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.490068 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.490069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.490180 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.490669 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:00.490676 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:00.492136 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:00.493652 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:00.493667 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:00.493669 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:00.493898 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:00.494083 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:00.494084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:00.494084 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:00.494186 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:00.494484 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:00.494490 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:00.494608 (+ 118us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.494695 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.494817 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":100,"threads_started":1}
I20260811 18:57:00.495667 22332 heartbeater.cc:347] Connected to a master server at 127.23.226.254:39559
I20260811 18:57:00.495761 22332 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:00.495843 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 22122
I20260811 18:57:00.495937 22332 heartbeater.cc:511] Master 127.23.226.254:39559 requested a full tablet report, sending...
I20260811 18:57:00.496003 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:00.496212 24459 external_mini_cluster.cc:1428] Setting key afc7598571d1b0f58de5b4a9bb243e9f
I20260811 18:57:00.496356 21586 ts_manager.cc:194] Registered new tserver with Master: 4f5576ecb9584e61b45d172694eb5f62 (127.23.226.195:32961)
I20260811 18:57:00.496924 21586 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.23.226.195@KRBTEST.COM'} at 127.23.226.195:55819
I20260811 18:57:00.497134 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:57:00.504372 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.498630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59450 (local address 127.23.226.254:39559)
0811 18:57:00.498668 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.498669 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.498799 (+ 130us) server_negotiation.cc:407] Connection header received
0811 18:57:00.498895 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.498896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.498908 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.498975 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:00.499499 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.499987 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.500694 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.500878 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.500934 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.502059 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:00.502060 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:00.502061 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:00.502067 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:00.503378 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:00.503698 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:00.503699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:00.503699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:00.503754 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:00.503925 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:00.503925 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:00.503926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:00.504071 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:00.504153 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.504242 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.504305 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:00.505991 21586 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:00.507589 21586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:00.514554 22358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.510295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43232 (local address 127.23.226.194:39331)
0811 18:57:00.510543 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.510548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.510558 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:57:00.510598 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.510600 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.510617 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.510709 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:00.510902 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.512028 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.513353 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.514012 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.514078 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.514122 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.514406 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.514470 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":80,"threads_started":1}
I20260811 18:57:00.514604 22355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.510294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:32961 (local address 127.0.0.1:34020)
0811 18:57:00.510483 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.510495 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.510547 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.510871 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.510872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.510873 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:00.510915 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.510917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.512180 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.512181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.513093 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.513095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.514145 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.514147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.514259 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.514280 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.514376 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.514475 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":9,"thread_start_us":71,"threads_started":1}
I20260811 18:57:00.514619 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.510104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39331 (local address 127.0.0.1:43232)
0811 18:57:00.510434 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.510445 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.510498 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.510731 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.510734 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.510737 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:00.510808 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.510810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.512134 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.512135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.513263 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.513266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.514146 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.514147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.514259 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.514279 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.514376 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.514475 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":50,"thread_start_us":86,"threads_started":1}
I20260811 18:57:00.514832 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.510403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34020 (local address 127.23.226.195:32961)
0811 18:57:00.510659 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.510663 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.510670 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:57:00.510730 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.510732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.510762 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.510995 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:00.511060 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.512092 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.513189 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.513959 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.514048 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.514114 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.514696 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.514753 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":115,"threads_started":1}
I20260811 18:57:00.515336 22353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.509881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:38913 (local address 127.0.0.1:49840)
0811 18:57:00.510020 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.510064 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.510136 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.511029 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.511030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.511033 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:00.511097 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.511098 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.511967 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.511968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.513264 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.513266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.515063 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.515065 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.515146 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.515150 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.515205 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.515255 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":3,"thread_start_us":69,"threads_started":1}
I20260811 18:57:00.515580 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.510013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49840 (local address 127.23.226.193:38913)
0811 18:57:00.510859 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.510864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.510874 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:57:00.510916 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.510918 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.510944 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.511018 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:00.511156 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.511856 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.514160 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.514887 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.514966 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.515025 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.515457 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.515504 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":134,"threads_started":1}
I20260811 18:57:00.515821 21996 tablet_service.cc:1467] Processing CreateTablet for tablet 46712b757b194ed5bcd914357892dea5 (DEFAULT_TABLE table=test-table [id=d394275128bd43259dedb3a7def67c9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:00.515842 22224 tablet_service.cc:1467] Processing CreateTablet for tablet 46712b757b194ed5bcd914357892dea5 (DEFAULT_TABLE table=test-table [id=d394275128bd43259dedb3a7def67c9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:00.516188 22224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46712b757b194ed5bcd914357892dea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:00.516192 21996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46712b757b194ed5bcd914357892dea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:00.516229 21775 tablet_service.cc:1467] Processing CreateTablet for tablet 46712b757b194ed5bcd914357892dea5 (DEFAULT_TABLE table=test-table [id=d394275128bd43259dedb3a7def67c9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:00.516538 21775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46712b757b194ed5bcd914357892dea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:00.519164 22362 tablet_bootstrap.cc:492] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: Bootstrap starting.
I20260811 18:57:00.519567 22365 tablet_bootstrap.cc:492] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305: Bootstrap starting.
I20260811 18:57:00.520260 22365 tablet_bootstrap.cc:654] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:00.520260 22362 tablet_bootstrap.cc:654] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:00.521010 22362 log.cc:824] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:00.521040 22365 log.cc:824] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:00.521390 22366 tablet_bootstrap.cc:492] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a: Bootstrap starting.
I20260811 18:57:00.521937 22365 tablet_bootstrap.cc:492] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305: No bootstrap required, opened a new log
I20260811 18:57:00.522023 22365 ts_tablet_manager.cc:1397] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:57:00.522073 22362 tablet_bootstrap.cc:492] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: No bootstrap required, opened a new log
I20260811 18:57:00.522167 22362 ts_tablet_manager.cc:1397] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:57:00.522959 22366 tablet_bootstrap.cc:654] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:00.523474 22366 log.cc:824] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:00.524151 22366 tablet_bootstrap.cc:492] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a: No bootstrap required, opened a new log
I20260811 18:57:00.524230 22366 ts_tablet_manager.cc:1397] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 18:57:00.524294 22365 raft_consensus.cc:348] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
I20260811 18:57:00.524294 22362 raft_consensus.cc:348] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
I20260811 18:57:00.524498 22362 raft_consensus.cc:374] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:00.524498 22365 raft_consensus.cc:374] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:00.524550 22365 raft_consensus.cc:729] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ef9e6ac49e1475fa1758437fd1b4305, State: Initialized, Role: FOLLOWER
I20260811 18:57:00.524550 22362 raft_consensus.cc:729] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f5576ecb9584e61b45d172694eb5f62, State: Initialized, Role: FOLLOWER
I20260811 18:57:00.524700 22362 consensus_queue.cc:260] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
I20260811 18:57:00.524700 22365 consensus_queue.cc:260] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
I20260811 18:57:00.525029 22362 ts_tablet_manager.cc:1428] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:00.525102 22332 heartbeater.cc:503] Master 127.23.226.254:39559 was elected leader, sending a full tablet report...
I20260811 18:57:00.525161 22365 ts_tablet_manager.cc:1428] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 18:57:00.525305 22111 heartbeater.cc:503] Master 127.23.226.254:39559 was elected leader, sending a full tablet report...
I20260811 18:57:00.526248 22366 raft_consensus.cc:348] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
I20260811 18:57:00.526477 22366 raft_consensus.cc:374] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:00.526528 22366 raft_consensus.cc:729] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0138a5b350484b6fa3e27f4dbd1bcf6a, State: Initialized, Role: FOLLOWER
I20260811 18:57:00.526639 22366 consensus_queue.cc:260] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
I20260811 18:57:00.526911 22366 ts_tablet_manager.cc:1428] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:00.526973 21887 heartbeater.cc:503] Master 127.23.226.254:39559 was elected leader, sending a full tablet report...
I20260811 18:57:00.557843 22376 raft_consensus.cc:482] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:00.557963 22376 raft_consensus.cc:504] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
I20260811 18:57:00.558380 22376 leader_election.cc:288] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0138a5b350484b6fa3e27f4dbd1bcf6a (127.23.226.193:38913), 4f5576ecb9584e61b45d172694eb5f62 (127.23.226.195:32961)
I20260811 18:57:00.561275 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.558670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:46219 (local address 127.23.226.193:38913)
0811 18:57:00.558733 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.558735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.558747 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:57:00.558778 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.558779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.558790 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.558878 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:00.559050 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.559538 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.560496 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.560898 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.560988 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.560997 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.561166 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.561207 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 18:57:00.561264 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.558570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:38913 (local address 127.23.226.194:46219)
0811 18:57:00.558649 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.558664 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.558713 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.558885 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.558887 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.558889 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:00.558964 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.558965 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.559626 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.559627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.560396 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.560398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.560985 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.560987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.561071 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.561075 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.561147 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.561190 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 18:57:00.561698 21813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46712b757b194ed5bcd914357892dea5" candidate_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" is_pre_election: true
I20260811 18:57:00.561931 21813 raft_consensus.cc:2454] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ef9e6ac49e1475fa1758437fd1b4305 in term 0.
I20260811 18:57:00.561945 22380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.558722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:32961 (local address 127.23.226.194:44079)
0811 18:57:00.558919 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.558929 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.558995 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.559208 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.559209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.559211 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:00.559305 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.559315 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.560051 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.560053 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.560913 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.560915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.561691 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.561692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.561754 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.561758 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.561805 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.561832 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":128,"threads_started":1}
I20260811 18:57:00.561970 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.558857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:44079 (local address 127.23.226.195:32961)
0811 18:57:00.558910 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.558913 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.559006 (+ 93us) server_negotiation.cc:407] Connection header received
0811 18:57:00.559063 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.559064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.559074 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.559190 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:00.559413 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.559951 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.561033 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.561595 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.561681 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.561693 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.561846 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.561892 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 18:57:00.562196 21923 leader_election.cc:302] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0138a5b350484b6fa3e27f4dbd1bcf6a, 7ef9e6ac49e1475fa1758437fd1b4305; no voters:
I20260811 18:57:00.562342 22376 raft_consensus.cc:2781] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:00.562320 22256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46712b757b194ed5bcd914357892dea5" candidate_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f5576ecb9584e61b45d172694eb5f62" is_pre_election: true
I20260811 18:57:00.562426 22376 raft_consensus.cc:482] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:00.562481 22376 raft_consensus.cc:3037] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:00.562530 22256 raft_consensus.cc:2454] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ef9e6ac49e1475fa1758437fd1b4305 in term 0.
I20260811 18:57:00.563318 22376 raft_consensus.cc:504] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
I20260811 18:57:00.563457 22376 leader_election.cc:288] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [CANDIDATE]: Term 1 election: Requested vote from peers 0138a5b350484b6fa3e27f4dbd1bcf6a (127.23.226.193:38913), 4f5576ecb9584e61b45d172694eb5f62 (127.23.226.195:32961)
I20260811 18:57:00.563645 22256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46712b757b194ed5bcd914357892dea5" candidate_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f5576ecb9584e61b45d172694eb5f62"
I20260811 18:57:00.563686 21813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46712b757b194ed5bcd914357892dea5" candidate_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a"
I20260811 18:57:00.563730 22256 raft_consensus.cc:3037] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:00.563781 21813 raft_consensus.cc:3037] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:00.564455 22256 raft_consensus.cc:2454] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ef9e6ac49e1475fa1758437fd1b4305 in term 1.
I20260811 18:57:00.564654 21813 raft_consensus.cc:2454] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ef9e6ac49e1475fa1758437fd1b4305 in term 1.
I20260811 18:57:00.564678 21923 leader_election.cc:302] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f5576ecb9584e61b45d172694eb5f62, 7ef9e6ac49e1475fa1758437fd1b4305; no voters:
I20260811 18:57:00.564795 22376 raft_consensus.cc:2781] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:00.565028 22376 raft_consensus.cc:686] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [term 1 LEADER]: Becoming Leader. State: Replica: 7ef9e6ac49e1475fa1758437fd1b4305, State: Running, Role: LEADER
I20260811 18:57:00.565161 22376 consensus_queue.cc:237] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } }
W20260811 18:57:00.565963 22113 tablet.cc:2369] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:00.566088 21586 catalog_manager.cc:5495] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ef9e6ac49e1475fa1758437fd1b4305 (127.23.226.194). New cstate: current_term: 1 leader_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ef9e6ac49e1475fa1758437fd1b4305" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 } health_report { overall_health: UNKNOWN } } }
I20260811 18:57:00.571826 22358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.569317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43242 (local address 127.23.226.194:39331)
0811 18:57:00.569360 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.569362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.569371 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:00.569437 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.569438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.569456 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.569526 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:00.569694 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.570153 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.571003 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.571231 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.571312 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.571495 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:00.571599 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:00.571704 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.571724 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.571744 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:57:00.573786 22256 raft_consensus.cc:1261] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 1 FOLLOWER]: Refusing update from remote peer 7ef9e6ac49e1475fa1758437fd1b4305: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:00.573786 21813 raft_consensus.cc:1261] T 46712b757b194ed5bcd914357892dea5 P 0138a5b350484b6fa3e27f4dbd1bcf6a [term 1 FOLLOWER]: Refusing update from remote peer 7ef9e6ac49e1475fa1758437fd1b4305: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:00.574195 22376 consensus_queue.cc:1035] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0138a5b350484b6fa3e27f4dbd1bcf6a" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:00.574395 22382 consensus_queue.cc:1035] T 46712b757b194ed5bcd914357892dea5 P 7ef9e6ac49e1475fa1758437fd1b4305 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f5576ecb9584e61b45d172694eb5f62" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 32961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:00.577414 22385 mvcc.cc:205] Tried to move back new op lower bound from 7317400045866795008 to 7317400045835550720. Current Snapshot: MvccSnapshot[applied={T|T < 7317400045866795008 or (T in {7317400045866795008})}]
I20260811 18:57:00.579663 21585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:00.579790 21585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:00.580595 21585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 711759b1d5674b5babea877722191e77: Sending DeleteTablet for 3 replicas of tablet 46712b757b194ed5bcd914357892dea5
I20260811 18:57:00.581066 21775 tablet_service.cc:1514] Processing DeleteTablet for tablet 46712b757b194ed5bcd914357892dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:00 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:49840
I20260811 18:57:00.581076 22224 tablet_service.cc:1514] Processing DeleteTablet for tablet 46712b757b194ed5bcd914357892dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:00 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:34020
I20260811 18:57:00.581665 22398 tablet_replica.cc:330] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: stopping tablet replica
I20260811 18:57:00.581638 21996 tablet_service.cc:1514] Processing DeleteTablet for tablet 46712b757b194ed5bcd914357892dea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:00 UTC) from {username='kudu', principal='kudu/127.23.226.254@KRBTEST.COM'} at 127.0.0.1:43232
I20260811 18:57:00.581677 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 21681
I20260811 18:57:00.591962 22398 raft_consensus.cc:2229] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:00.592155 22398 raft_consensus.cc:2258] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:00.593410 22398 ts_tablet_manager.cc:1905] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:00.595235 22398 ts_tablet_manager.cc:1918] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:00.595332 22398 log.cc:1196] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/46712b757b194ed5bcd914357892dea5
I20260811 18:57:00.595633 22398 ts_tablet_manager.cc:1939] T 46712b757b194ed5bcd914357892dea5 P 4f5576ecb9584e61b45d172694eb5f62: Deleting consensus metadata
I20260811 18:57:00.596122 21564 catalog_manager.cc:4841] TS 4f5576ecb9584e61b45d172694eb5f62 (127.23.226.195:32961): tablet 46712b757b194ed5bcd914357892dea5 (table test-table [id=d394275128bd43259dedb3a7def67c9f]) successfully deleted
W20260811 18:57:00.598155 21564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:38913 (error 108)
I20260811 18:57:00.598387 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 21897
I20260811 18:57:00.607368 22353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.607151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:38913 (local address 127.0.0.1:49848)
0811 18:57:00.607239 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.607312 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:38913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 18:57:00.607542 21564 catalog_manager.cc:4584] TS 0138a5b350484b6fa3e27f4dbd1bcf6a (127.23.226.193:38913): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 46712b757b194ed5bcd914357892dea5: Network error: Client connection negotiation failed: client connection to 127.23.226.193:38913: connect: Connection refused (error 111)
I20260811 18:57:00.611950 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 22122
I20260811 18:57:00.611994 22353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.611850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:39331 (local address 127.0.0.1:43244)
0811 18:57:00.611914 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.611953 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.194:39331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 18:57:00.619719 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 21543
2026-08-11T18:57:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2243 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T18:57:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:00Z Disabled control of system clock
I20260811 18:57:00.658372 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42421
--webserver_interface=127.23.226.254
--webserver_port=0
--builtin_ntp_servers=127.23.226.212:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:42421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:57:00.742201 22411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:00.742444 22411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:00.742466 22411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:00.743674 22411 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:00.743721 22411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:00.743733 22411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:00.743748 22411 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:00.743762 22411 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:00.745129 22411 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:42421
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:00.745396 22411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:00.745693 22411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:57:00.750771 22411 server_base.cc:1034] running on GCE node
W20260811 18:57:00.750723 22424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.750728 22420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.750738 22417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:00.751143 22411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:00.751454 22411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:00.752605 22411 hybrid_clock.cc:648] HybridClock initialized: now 1786474620752592 us; error 34 us; skew 500 ppm
I20260811 18:57:00.753906 22411 webserver.cc:460] Webserver started at http://127.23.226.254:39139/ using document root <none> and password file <none>
I20260811 18:57:00.754127 22411 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:00.754195 22411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:00.754354 22411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:00.755412 22411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "4baa9e18b352463dbafd8c0b6be9cbcd"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "064fd161dab7628360c8603ed44303ee"
server_key_iv: "d6c7f024dfddb0e7e827dc0d670b8967"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.755784 22411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "4baa9e18b352463dbafd8c0b6be9cbcd"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "064fd161dab7628360c8603ed44303ee"
server_key_iv: "d6c7f024dfddb0e7e827dc0d670b8967"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.757170 22411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:00.757932 22437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.758121 22411 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:00.758224 22411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "4baa9e18b352463dbafd8c0b6be9cbcd"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "064fd161dab7628360c8603ed44303ee"
server_key_iv: "d6c7f024dfddb0e7e827dc0d670b8967"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.758308 22411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:00.765120 22411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:00.765400 22411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:00.765548 22411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:00.769717 22411 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:42421
I20260811 18:57:00.769753 22518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:42421 every 8 connection(s)
I20260811 18:57:00.770082 22411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:00.771155 22519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:00.772998 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 22411
I20260811 18:57:00.773120 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:00.773317 24459 external_mini_cluster.cc:1428] Setting key 2c65fb4bf09d48a94ae24a14fe6929c4
I20260811 18:57:00.773643 22519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd: Bootstrap starting.
I20260811 18:57:00.774411 22519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:00.774801 22519 log.cc:824] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:00.775653 22519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd: No bootstrap required, opened a new log
I20260811 18:57:00.777885 22519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4baa9e18b352463dbafd8c0b6be9cbcd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42421 } }
I20260811 18:57:00.778050 22519 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:00.778090 22519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4baa9e18b352463dbafd8c0b6be9cbcd, State: Initialized, Role: FOLLOWER
I20260811 18:57:00.778244 22519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4baa9e18b352463dbafd8c0b6be9cbcd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42421 } }
I20260811 18:57:00.778333 22519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:00.778373 22519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:00.778455 22519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:00.779044 22519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4baa9e18b352463dbafd8c0b6be9cbcd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42421 } }
I20260811 18:57:00.779165 22519 leader_election.cc:302] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4baa9e18b352463dbafd8c0b6be9cbcd; no voters:
I20260811 18:57:00.779328 22519 leader_election.cc:288] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:00.779605 22527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:00.779700 22519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:00.779760 22527 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [term 1 LEADER]: Becoming Leader. State: Replica: 4baa9e18b352463dbafd8c0b6be9cbcd, State: Running, Role: LEADER
I20260811 18:57:00.779870 22527 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4baa9e18b352463dbafd8c0b6be9cbcd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42421 } }
I20260811 18:57:00.779937 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.773854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58470 (local address 127.23.226.254:42421)
0811 18:57:00.774110 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.774120 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.774156 (+ 36us) server_negotiation.cc:407] Connection header received
0811 18:57:00.774831 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.774840 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.774920 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.775089 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:00.775323 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.776688 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.777448 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.778107 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.778227 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.778969 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:00.778974 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:00.778974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:00.779198 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:00.779242 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:00.779259 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:00.779351 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.779500 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.779703 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260811 18:57:00.780239 22527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4baa9e18b352463dbafd8c0b6be9cbcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4baa9e18b352463dbafd8c0b6be9cbcd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42421 } } }
I20260811 18:57:00.780324 22527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:00.780463 22527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4baa9e18b352463dbafd8c0b6be9cbcd. Latest consensus state: current_term: 1 leader_uuid: "4baa9e18b352463dbafd8c0b6be9cbcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4baa9e18b352463dbafd8c0b6be9cbcd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42421 } } }
I20260811 18:57:00.780525 22527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:00.781086 22537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:00.781594 22537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:00.783138 22537 catalog_manager.cc:1347] Generated new cluster ID: 503f549c65a449bebc5da4acce5a3e9a
I20260811 18:57:00.783193 22537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:00.794198 22537 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:00.794898 22537 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:00.819828 22537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd: Generated new TSK 0
I20260811 18:57:00.820086 22537 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:00.824523 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.193:0
--local_ip_for_outbound_sockets=127.23.226.193
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42421
--builtin_ntp_servers=127.23.226.212:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:57:00.909987 22563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:00.910229 22563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:00.910265 22563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:00.911469 22563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:00.911540 22563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:00.911581 22563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.193
I20260811 18:57:00.912968 22563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.23.226.193
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.193
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:00.913255 22563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:00.913569 22563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:00.919544 22573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.919584 22574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:00.919672 22576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:00.919915 22563 server_base.cc:1034] running on GCE node
I20260811 18:57:00.920127 22563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:00.920397 22563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:00.921551 22563 hybrid_clock.cc:648] HybridClock initialized: now 1786474620921540 us; error 29 us; skew 500 ppm
I20260811 18:57:00.922976 22563 webserver.cc:460] Webserver started at http://127.23.226.193:45383/ using document root <none> and password file <none>
I20260811 18:57:00.923250 22563 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:00.923329 22563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:00.923485 22563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:00.924566 22563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/data/instance:
uuid: "0a65918a9087422a9433c9a402ce1af9"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "759d9cb199308f72015075c07f01792e"
server_key_iv: "4115359148d0e11a56fc1aa8f2d8db6b"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.924947 22563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance:
uuid: "0a65918a9087422a9433c9a402ce1af9"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "759d9cb199308f72015075c07f01792e"
server_key_iv: "4115359148d0e11a56fc1aa8f2d8db6b"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.926503 22563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:00.927304 22590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.927536 22563 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:00.927634 22563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/wal
uuid: "0a65918a9087422a9433c9a402ce1af9"
format_stamp: "Formatted at 2026-08-11 18:57:00 on dist-test-slave-68xk"
server_key: "759d9cb199308f72015075c07f01792e"
server_key_iv: "4115359148d0e11a56fc1aa8f2d8db6b"
server_key_version: "encryptionkey@0"
I20260811 18:57:00.927723 22563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:00.952692 22563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:00.953037 22563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:00.953195 22563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:00.953450 22563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:00.953791 22563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:00.953848 22563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.953893 22563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:00.953919 22563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:00.960306 22563 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.193:35221
I20260811 18:57:00.960361 22774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.193:35221 every 8 connection(s)
I20260811 18:57:00.960767 22563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/data/info.pb
I20260811 18:57:00.966197 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.961584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:45871 (local address 127.23.226.254:42421)
0811 18:57:00.961680 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:00.961683 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:00.961941 (+ 258us) server_negotiation.cc:407] Connection header received
0811 18:57:00.962457 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:00.962459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:00.962471 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:00.962523 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:00.963233 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.963815 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.964793 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.965007 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.965100 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.965934 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:00.965936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:00.965936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:00.965941 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:00.965955 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:00.965959 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:00.966012 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:00.966108 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 18:57:00.966132 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:57:00.966357 22780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:00.961548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42421 (local address 127.23.226.193:45871)
0811 18:57:00.961801 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:00.961839 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:00.962345 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:00.962597 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:00.962600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:00.962608 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:00.963116 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.963120 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.963911 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.963912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.964684 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:00.964686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:00.965112 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:00.965113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:00.965223 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:00.965785 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:57:00.965785 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:00.965814 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:57:00.965836 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:00.966021 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:00.966025 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:00.966028 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:57:00.966081 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 18:57:00.966161 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":143,"threads_started":1}
I20260811 18:57:00.966944 22778 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42421
I20260811 18:57:00.967047 22778 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:00.967227 22778 heartbeater.cc:511] Master 127.23.226.254:42421 requested a full tablet report, sending...
I20260811 18:57:00.967803 22463 ts_manager.cc:194] Registered new tserver with Master: 0a65918a9087422a9433c9a402ce1af9 (127.23.226.193:35221)
I20260811 18:57:00.968519 22463 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.193:45871
I20260811 18:57:00.970999 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 22563
I20260811 18:57:00.971138 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-0/wal/instance
I20260811 18:57:00.971365 24459 external_mini_cluster.cc:1428] Setting key 5fb7b69bb31aa5582b7a5fea552b5304
I20260811 18:57:00.972340 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.194:0
--local_ip_for_outbound_sockets=127.23.226.194
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42421
--builtin_ntp_servers=127.23.226.212:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 18:57:01.069972 22781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:01.070189 22781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:01.070211 22781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:01.071451 22781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:01.071496 22781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:01.071521 22781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.194
I20260811 18:57:01.072897 22781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.23.226.194
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.194
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:01.073168 22781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:01.073474 22781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:01.078564 22795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:01.078576 22791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:01.078610 22792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:01.078850 22781 server_base.cc:1034] running on GCE node
I20260811 18:57:01.079237 22781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:01.079524 22781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:01.080715 22781 hybrid_clock.cc:648] HybridClock initialized: now 1786474621080698 us; error 31 us; skew 500 ppm
I20260811 18:57:01.082018 22781 webserver.cc:460] Webserver started at http://127.23.226.194:33555/ using document root <none> and password file <none>
I20260811 18:57:01.082365 22781 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:01.082500 22781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:01.082646 22781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:01.083717 22781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/data/instance:
uuid: "c6930d7e1c29460fb492758a33eb802a"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-68xk"
server_key: "87bfd71ece02326af0fb7ee465a2d5f2"
server_key_iv: "b810f44d87e744876736b638a74cc7f7"
server_key_version: "encryptionkey@0"
I20260811 18:57:01.084097 22781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance:
uuid: "c6930d7e1c29460fb492758a33eb802a"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-68xk"
server_key: "87bfd71ece02326af0fb7ee465a2d5f2"
server_key_iv: "b810f44d87e744876736b638a74cc7f7"
server_key_version: "encryptionkey@0"
I20260811 18:57:01.085474 22781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:57:01.086266 22803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:01.086498 22781 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:01.086603 22781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/wal
uuid: "c6930d7e1c29460fb492758a33eb802a"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-68xk"
server_key: "87bfd71ece02326af0fb7ee465a2d5f2"
server_key_iv: "b810f44d87e744876736b638a74cc7f7"
server_key_version: "encryptionkey@0"
I20260811 18:57:01.086676 22781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:01.098332 22781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:01.098641 22781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:01.098791 22781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:01.099020 22781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:01.099349 22781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:01.099406 22781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:01.099445 22781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:01.099473 22781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:01.105403 22781 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.194:34853
I20260811 18:57:01.105502 22993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.194:34853 every 8 connection(s)
I20260811 18:57:01.105798 22781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/data/info.pb
I20260811 18:57:01.108503 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 22781
I20260811 18:57:01.108621 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/wal/instance
I20260811 18:57:01.108819 24459 external_mini_cluster.cc:1428] Setting key ad95fd34e4281840dad154ce4f88ffd8
I20260811 18:57:01.109879 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.23.226.195:0
--local_ip_for_outbound_sockets=127.23.226.195
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42421
--builtin_ntp_servers=127.23.226.212:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 18:57:01.111799 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.106602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.194:58875 (local address 127.23.226.254:42421)
0811 18:57:01.106647 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.106649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.106880 (+ 231us) server_negotiation.cc:407] Connection header received
0811 18:57:01.107408 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.107410 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.107425 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.107485 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:01.108188 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.108989 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.110259 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.110509 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.110575 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.111469 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:01.111470 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:01.111470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:01.111475 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:01.111488 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:01.111492 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:01.111536 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.111640 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.111689 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:01.112006 22998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.106591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42421 (local address 127.23.226.194:58875)
0811 18:57:01.106763 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.106795 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:01.107301 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:01.107548 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:01.107552 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:01.107561 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:01.108088 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.108093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.109092 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.109093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.110173 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.110176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.110601 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.110603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.110764 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.111312 (+ 548us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:57:01.111312 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:01.111351 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:57:01.111378 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:01.111555 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:01.111559 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:01.111562 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 18:57:01.111626 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 18:57:01.111748 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":72,"threads_started":1}
I20260811 18:57:01.112480 22995 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42421
I20260811 18:57:01.112591 22995 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:01.112799 22995 heartbeater.cc:511] Master 127.23.226.254:42421 requested a full tablet report, sending...
I20260811 18:57:01.113209 22463 ts_manager.cc:194] Registered new tserver with Master: c6930d7e1c29460fb492758a33eb802a (127.23.226.194:34853)
I20260811 18:57:01.113699 22463 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.194:58875
W20260811 18:57:01.195843 22999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:01.196054 22999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:01.196077 22999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:01.197171 22999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:01.197211 22999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:01.197235 22999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.226.195
I20260811 18:57:01.198540 22999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.23.226.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.23.226.195
--webserver_port=0
--tserver_master_addrs=127.23.226.254:42421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.23.226.195
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:01.198737 22999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:01.198999 22999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:01.203979 23010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:01.204084 23015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:01.204162 23011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:01.204169 22999 server_base.cc:1034] running on GCE node
I20260811 18:57:01.204523 22999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:01.204797 22999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:01.205981 22999 hybrid_clock.cc:648] HybridClock initialized: now 1786474621205964 us; error 36 us; skew 500 ppm
I20260811 18:57:01.207340 22999 webserver.cc:460] Webserver started at http://127.23.226.195:36575/ using document root <none> and password file <none>
I20260811 18:57:01.207592 22999 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:01.207664 22999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:01.207829 22999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:01.208904 22999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/data/instance:
uuid: "970839320aba46af969287aeb89de000"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-68xk"
server_key: "e02fd6290c83c471d8fb87da1eb11f68"
server_key_iv: "605821f0a121a7335b10408edfe6ce6b"
server_key_version: "encryptionkey@0"
I20260811 18:57:01.209282 22999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance:
uuid: "970839320aba46af969287aeb89de000"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-68xk"
server_key: "e02fd6290c83c471d8fb87da1eb11f68"
server_key_iv: "605821f0a121a7335b10408edfe6ce6b"
server_key_version: "encryptionkey@0"
I20260811 18:57:01.210793 22999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:57:01.211722 23027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:01.211901 22999 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:01.212015 22999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/wal
uuid: "970839320aba46af969287aeb89de000"
format_stamp: "Formatted at 2026-08-11 18:57:01 on dist-test-slave-68xk"
server_key: "e02fd6290c83c471d8fb87da1eb11f68"
server_key_iv: "605821f0a121a7335b10408edfe6ce6b"
server_key_version: "encryptionkey@0"
I20260811 18:57:01.212139 22999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:01.229765 22999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:01.230063 22999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:01.230239 22999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:01.230517 22999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 18:57:01.230899 22999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 18:57:01.230957 22999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:01.230997 22999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 18:57:01.231024 22999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:01.237114 22999 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.195:38029
I20260811 18:57:01.237160 23216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.195:38029 every 8 connection(s)
I20260811 18:57:01.237481 22999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/data/info.pb
I20260811 18:57:01.242916 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.238207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.195:48879 (local address 127.23.226.254:42421)
0811 18:57:01.238277 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.238280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.238582 (+ 302us) server_negotiation.cc:407] Connection header received
0811 18:57:01.239067 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.239068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.239083 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.239340 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:01.240038 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.240608 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.241599 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.241810 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.241877 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.242683 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:01.242684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:01.242685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:01.242689 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:01.242703 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:01.242708 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:01.242756 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.242823 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.242847 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 18:57:01.243065 23220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.238210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:42421 (local address 127.23.226.195:48879)
0811 18:57:01.238404 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.238472 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:01.238967 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:01.239417 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:01.239421 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:01.239429 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:01.239939 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.239944 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.240725 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.240727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.241500 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.241502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.241900 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.241901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.242005 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.242540 (+ 535us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 18:57:01.242541 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:01.242568 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 18:57:01.242589 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:01.242758 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:01.242760 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:01.242762 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 18:57:01.242808 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 18:57:01.242881 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260811 18:57:01.243606 23217 heartbeater.cc:347] Connected to a master server at 127.23.226.254:42421
I20260811 18:57:01.243721 23217 heartbeater.cc:464] Registering TS with master...
I20260811 18:57:01.243923 23217 heartbeater.cc:511] Master 127.23.226.254:42421 requested a full tablet report, sending...
I20260811 18:57:01.244415 22463 ts_manager.cc:194] Registered new tserver with Master: 970839320aba46af969287aeb89de000 (127.23.226.195:38029)
I20260811 18:57:01.244875 22463 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.226.195:48879
I20260811 18:57:01.246591 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 22999
I20260811 18:57:01.246678 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/wal/instance
I20260811 18:57:01.246831 24459 external_mini_cluster.cc:1428] Setting key ca05fc0326a9ee5bf2d1adf0349b3542
I20260811 18:57:01.247720 24459 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 18:57:01.252141 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.249148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58480 (local address 127.23.226.254:42421)
0811 18:57:01.249203 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.249205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.249343 (+ 138us) server_negotiation.cc:407] Connection header received
0811 18:57:01.249391 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.249392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.249402 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.249456 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:01.249571 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.250064 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.250834 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.251037 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.251139 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.251822 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:01.251824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:01.251824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:01.251828 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:01.251841 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:01.251844 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:01.251898 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.251955 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.251974 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:57:01.253660 22463 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58480:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 18:57:01.255334 22463 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 18:57:01.262251 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.257781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:34853 (local address 127.0.0.1:47798)
0811 18:57:01.257987 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.258028 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:01.258157 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:01.258498 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:01.258501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:01.258504 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:01.258648 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.258650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.260051 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.260052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.261091 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.261094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.261921 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.261922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.262002 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.262016 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 18:57:01.262104 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 18:57:01.262164 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":30,"thread_start_us":96,"threads_started":1}
I20260811 18:57:01.262260 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.257921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47798 (local address 127.23.226.194:34853)
0811 18:57:01.258232 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.258236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.258278 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:57:01.258323 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.258325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.258343 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.258484 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:01.258743 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.259948 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.261179 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.261828 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.261911 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.262003 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.262133 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.262180 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":102,"threads_started":1}
I20260811 18:57:01.262614 23239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.257921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49850 (local address 127.23.226.193:35221)
0811 18:57:01.258146 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.258151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.258466 (+ 315us) server_negotiation.cc:407] Connection header received
0811 18:57:01.258601 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.258604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.258623 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.258676 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:01.258955 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.259659 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.261102 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.261937 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.262019 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.262155 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.262469 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.262516 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":107,"threads_started":1}
I20260811 18:57:01.262686 23242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.258183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58608 (local address 127.23.226.195:38029)
0811 18:57:01.258405 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.258429 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.258713 (+ 284us) server_negotiation.cc:407] Connection header received
0811 18:57:01.258756 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.258758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.258772 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.258851 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:01.259001 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.260055 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.261283 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.261963 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.262023 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.262116 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.262545 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.262592 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":92,"threads_started":1}
I20260811 18:57:01.262777 23241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.258015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:38029 (local address 127.0.0.1:58608)
0811 18:57:01.258590 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.258601 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:01.258652 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:01.258865 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:01.258866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:01.258869 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:01.258908 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.258910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.260147 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.260148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.261206 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.261208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.262154 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.262155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.262226 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.262230 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:01.262284 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 18:57:01.262335 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"mutex_wait_us":1,"thread_start_us":70,"threads_started":1}
I20260811 18:57:01.262836 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.257781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:35221 (local address 127.0.0.1:49850)
0811 18:57:01.258360 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.258373 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:01.258500 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:01.258803 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:01.258804 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:01.258807 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:01.258861 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.258862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.259756 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.259757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.260971 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.260973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.262184 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.262184 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.262239 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.262243 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:01.262299 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 18:57:01.262332 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":7,"thread_start_us":84,"threads_started":1}
I20260811 18:57:01.263417 22879 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec813f233d54a81889c99b8eef42ccf (DEFAULT_TABLE table=test-table [id=1b23306105824803bcfcc9850a6370d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:01.263527 23099 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec813f233d54a81889c99b8eef42ccf (DEFAULT_TABLE table=test-table [id=1b23306105824803bcfcc9850a6370d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:01.263664 22664 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec813f233d54a81889c99b8eef42ccf (DEFAULT_TABLE table=test-table [id=1b23306105824803bcfcc9850a6370d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 18:57:01.263854 22879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec813f233d54a81889c99b8eef42ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:01.263900 23099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec813f233d54a81889c99b8eef42ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:01.263968 22664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec813f233d54a81889c99b8eef42ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:01.266722 23244 tablet_bootstrap.cc:492] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Bootstrap starting.
I20260811 18:57:01.267445 23244 tablet_bootstrap.cc:654] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:01.267690 23246 tablet_bootstrap.cc:492] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9: Bootstrap starting.
I20260811 18:57:01.267807 23244 log.cc:824] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:01.268361 23246 tablet_bootstrap.cc:654] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:01.268693 23244 tablet_bootstrap.cc:492] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: No bootstrap required, opened a new log
I20260811 18:57:01.268680 23246 log.cc:824] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:01.268774 23244 ts_tablet_manager.cc:1397] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 18:57:01.267392 23247 tablet_bootstrap.cc:492] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: Bootstrap starting.
I20260811 18:57:01.269550 23247 tablet_bootstrap.cc:654] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:01.269893 23247 log.cc:824] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:01.270511 23246 tablet_bootstrap.cc:492] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9: No bootstrap required, opened a new log
I20260811 18:57:01.270584 23246 ts_tablet_manager.cc:1397] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 18:57:01.271854 23244 raft_consensus.cc:348] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.272032 23244 raft_consensus.cc:374] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:01.272073 23244 raft_consensus.cc:729] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6930d7e1c29460fb492758a33eb802a, State: Initialized, Role: FOLLOWER
I20260811 18:57:01.272205 23244 consensus_queue.cc:260] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.272478 23244 ts_tablet_manager.cc:1428] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 18:57:01.272544 22995 heartbeater.cc:503] Master 127.23.226.254:42421 was elected leader, sending a full tablet report...
I20260811 18:57:01.273010 23246 raft_consensus.cc:348] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.273160 23246 raft_consensus.cc:374] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:01.273196 23246 raft_consensus.cc:729] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a65918a9087422a9433c9a402ce1af9, State: Initialized, Role: FOLLOWER
I20260811 18:57:01.273319 23246 consensus_queue.cc:260] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.273614 23246 ts_tablet_manager.cc:1428] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:01.273733 22778 heartbeater.cc:503] Master 127.23.226.254:42421 was elected leader, sending a full tablet report...
I20260811 18:57:01.274021 23247 tablet_bootstrap.cc:492] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: No bootstrap required, opened a new log
I20260811 18:57:01.274121 23247 ts_tablet_manager.cc:1397] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260811 18:57:01.276175 23247 raft_consensus.cc:348] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.276302 23247 raft_consensus.cc:374] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:01.276324 23247 raft_consensus.cc:729] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 970839320aba46af969287aeb89de000, State: Initialized, Role: FOLLOWER
I20260811 18:57:01.276434 23247 consensus_queue.cc:260] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.276649 23247 ts_tablet_manager.cc:1428] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 18:57:01.276803 23217 heartbeater.cc:503] Master 127.23.226.254:42421 was elected leader, sending a full tablet report...
W20260811 18:57:01.356418 22996 tablet.cc:2369] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 18:57:01.413025 23254 raft_consensus.cc:482] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 18:57:01.413203 23254 raft_consensus.cc:504] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.413625 23254 leader_election.cc:288] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6930d7e1c29460fb492758a33eb802a (127.23.226.194:34853), 970839320aba46af969287aeb89de000 (127.23.226.195:38029)
I20260811 18:57:01.417008 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.413895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:39423 (local address 127.23.226.194:34853)
0811 18:57:01.413976 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.413978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.414003 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:57:01.414037 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.414039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.414049 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.414102 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:01.414322 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.414894 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.416274 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.416647 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.416710 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.416717 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.416887 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.416939 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 18:57:01.417011 22780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.413812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.194:34853 (local address 127.23.226.193:39423)
0811 18:57:01.413875 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.413893 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:01.413950 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:01.414126 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:01.414127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:01.414130 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:01.414212 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.414214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.415027 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.415029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.416148 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.416151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.416734 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.416735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.416807 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.416811 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:01.416873 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 18:57:01.416923 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 18:57:01.417443 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec813f233d54a81889c99b8eef42ccf" candidate_uuid: "0a65918a9087422a9433c9a402ce1af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6930d7e1c29460fb492758a33eb802a" is_pre_election: true
I20260811 18:57:01.417644 22914 raft_consensus.cc:2454] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a65918a9087422a9433c9a402ce1af9 in term 0.
I20260811 18:57:01.417901 23259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.413980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.195:38029 (local address 127.23.226.193:55823)
0811 18:57:01.414225 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.414235 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:01.414291 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:01.415027 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:01.415029 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:01.415031 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 18:57:01.415102 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.415104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.415906 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.415907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.416885 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:01.416888 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.417629 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.417630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:01.417706 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.417710 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 18:57:01.417782 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 18:57:01.417820 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":182,"threads_started":1}
I20260811 18:57:01.417963 23242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.414061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.23.226.193:55823 (local address 127.23.226.195:38029)
0811 18:57:01.414140 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.414143 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.414892 (+ 749us) server_negotiation.cc:407] Connection header received
0811 18:57:01.414930 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.414931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.414943 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.415002 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 18:57:01.415230 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.415776 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.416969 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.417521 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.417613 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.417622 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.417846 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.417888 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 18:57:01.417932 22591 leader_election.cc:302] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a65918a9087422a9433c9a402ce1af9, c6930d7e1c29460fb492758a33eb802a; no voters:
I20260811 18:57:01.418109 23254 raft_consensus.cc:2781] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 18:57:01.418162 23254 raft_consensus.cc:482] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 18:57:01.418188 23254 raft_consensus.cc:3037] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:01.418352 23131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec813f233d54a81889c99b8eef42ccf" candidate_uuid: "0a65918a9087422a9433c9a402ce1af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "970839320aba46af969287aeb89de000" is_pre_election: true
I20260811 18:57:01.418581 23131 raft_consensus.cc:2454] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a65918a9087422a9433c9a402ce1af9 in term 0.
I20260811 18:57:01.419126 23254 raft_consensus.cc:504] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.419281 23254 leader_election.cc:288] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [CANDIDATE]: Term 1 election: Requested vote from peers c6930d7e1c29460fb492758a33eb802a (127.23.226.194:34853), 970839320aba46af969287aeb89de000 (127.23.226.195:38029)
I20260811 18:57:01.419452 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec813f233d54a81889c99b8eef42ccf" candidate_uuid: "0a65918a9087422a9433c9a402ce1af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6930d7e1c29460fb492758a33eb802a"
I20260811 18:57:01.419463 23131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec813f233d54a81889c99b8eef42ccf" candidate_uuid: "0a65918a9087422a9433c9a402ce1af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "970839320aba46af969287aeb89de000"
I20260811 18:57:01.419543 22914 raft_consensus.cc:3037] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:01.419535 23131 raft_consensus.cc:3037] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:01.420315 22914 raft_consensus.cc:2454] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a65918a9087422a9433c9a402ce1af9 in term 1.
I20260811 18:57:01.420435 23131 raft_consensus.cc:2454] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a65918a9087422a9433c9a402ce1af9 in term 1.
I20260811 18:57:01.420550 22591 leader_election.cc:302] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a65918a9087422a9433c9a402ce1af9, c6930d7e1c29460fb492758a33eb802a; no voters:
I20260811 18:57:01.420687 23254 raft_consensus.cc:2781] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:01.420877 23254 raft_consensus.cc:686] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [term 1 LEADER]: Becoming Leader. State: Replica: 0a65918a9087422a9433c9a402ce1af9, State: Running, Role: LEADER
I20260811 18:57:01.420977 23254 consensus_queue.cc:237] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } }
I20260811 18:57:01.421942 22463 catalog_manager.cc:5495] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a65918a9087422a9433c9a402ce1af9 (127.23.226.193). New cstate: current_term: 1 leader_uuid: "0a65918a9087422a9433c9a402ce1af9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a65918a9087422a9433c9a402ce1af9" member_type: VOTER last_known_addr { host: "127.23.226.193" port: 35221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 } health_report { overall_health: UNKNOWN } } }
I20260811 18:57:01.443657 23239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.441365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57520 (local address 127.23.226.193:35221)
0811 18:57:01.441418 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:01.441420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:01.441428 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:01.441465 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:01.441465 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:01.441487 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:01.441578 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:01.441675 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.442183 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.442968 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:01.443190 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:01.443257 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:01.443370 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:01.443464 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:01.443520 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:01.443553 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 18:57:01.443571 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:57:01.445590 22914 raft_consensus.cc:1261] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 1 FOLLOWER]: Refusing update from remote peer 0a65918a9087422a9433c9a402ce1af9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:01.445631 23131 raft_consensus.cc:1261] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 1 FOLLOWER]: Refusing update from remote peer 0a65918a9087422a9433c9a402ce1af9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:01.445927 23254 consensus_queue.cc:1035] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6930d7e1c29460fb492758a33eb802a" member_type: VOTER last_known_addr { host: "127.23.226.194" port: 34853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:01.446054 23264 consensus_queue.cc:1035] T 3ec813f233d54a81889c99b8eef42ccf P 0a65918a9087422a9433c9a402ce1af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "970839320aba46af969287aeb89de000" member_type: VOTER last_known_addr { host: "127.23.226.195" port: 38029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:01.448448 23268 mvcc.cc:205] Tried to move back new op lower bound from 7317400049437888512 to 7317400049341132800. Current Snapshot: MvccSnapshot[applied={T|T < 7317400049437888512}]
I20260811 18:57:01.448987 23272 mvcc.cc:205] Tried to move back new op lower bound from 7317400049437888512 to 7317400049341132800. Current Snapshot: MvccSnapshot[applied={T|T < 7317400049437888512}]
I20260811 18:57:01.449709 23271 mvcc.cc:205] Tried to move back new op lower bound from 7317400049437888512 to 7317400049341132800. Current Snapshot: MvccSnapshot[applied={T|T < 7317400049437888512 or (T in {7317400049437888512})}]
I20260811 18:57:01.451182 22463 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:01.451282 22463 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 18:57:01.452075 22463 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4baa9e18b352463dbafd8c0b6be9cbcd: Sending DeleteTablet for 3 replicas of tablet 3ec813f233d54a81889c99b8eef42ccf
I20260811 18:57:01.452423 22664 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ec813f233d54a81889c99b8eef42ccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:01 UTC) from {username='slave'} at 127.0.0.1:49850
I20260811 18:57:01.452435 22879 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ec813f233d54a81889c99b8eef42ccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:01 UTC) from {username='slave'} at 127.0.0.1:47798
I20260811 18:57:01.452466 23099 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ec813f233d54a81889c99b8eef42ccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 18:57:01 UTC) from {username='slave'} at 127.0.0.1:58608
I20260811 18:57:01.452687 23288 tablet_replica.cc:330] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: stopping tablet replica
I20260811 18:57:01.452795 23288 raft_consensus.cc:2229] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:01.452818 23287 tablet_replica.cc:330] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: stopping tablet replica
I20260811 18:57:01.452900 23288 raft_consensus.cc:2258] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:01.453007 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 22563
I20260811 18:57:01.453315 23288 ts_tablet_manager.cc:1905] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:01.455018 23288 ts_tablet_manager.cc:1918] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:01.455078 23288 log.cc:1196] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-2/wal/wals/3ec813f233d54a81889c99b8eef42ccf
I20260811 18:57:01.455292 23288 ts_tablet_manager.cc:1939] T 3ec813f233d54a81889c99b8eef42ccf P 970839320aba46af969287aeb89de000: Deleting consensus metadata
I20260811 18:57:01.455754 22439 catalog_manager.cc:4841] TS 970839320aba46af969287aeb89de000 (127.23.226.195:38029): tablet 3ec813f233d54a81889c99b8eef42ccf (table test-table [id=1b23306105824803bcfcc9850a6370d1]) successfully deleted
I20260811 18:57:01.453028 23287 raft_consensus.cc:2229] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 18:57:01.456053 23287 raft_consensus.cc:2258] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 18:57:01.456521 23287 ts_tablet_manager.cc:1905] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 18:57:01.458681 23287 ts_tablet_manager.cc:1918] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 18:57:01.458765 23287 log.cc:1196] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Deleting WAL directory at /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786474364687722-24459-0/minicluster-data/ts-1/wal/wals/3ec813f233d54a81889c99b8eef42ccf
I20260811 18:57:01.459024 23287 ts_tablet_manager.cc:1939] T 3ec813f233d54a81889c99b8eef42ccf P c6930d7e1c29460fb492758a33eb802a: Deleting consensus metadata
I20260811 18:57:01.461175 22438 catalog_manager.cc:4841] TS c6930d7e1c29460fb492758a33eb802a (127.23.226.194:34853): tablet 3ec813f233d54a81889c99b8eef42ccf (table test-table [id=1b23306105824803bcfcc9850a6370d1]) successfully deleted
W20260811 18:57:01.467224 22439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.23.226.193:35221 (error 108)
I20260811 18:57:01.467428 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 22781
I20260811 18:57:01.473626 23241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:01.473456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.193:35221 (local address 127.0.0.1:57532)
0811 18:57:01.473513 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:01.473578 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.193:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 18:57:01.473816 22439 catalog_manager.cc:4584] TS 0a65918a9087422a9433c9a402ce1af9 (127.23.226.193:35221): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3ec813f233d54a81889c99b8eef42ccf: Network error: Client connection negotiation failed: client connection to 127.23.226.193:35221: connect: Connection refused (error 111)
I20260811 18:57:01.477526 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 22999
I20260811 18:57:01.491742 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 22411
2026-08-11T18:57:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (868 ms)
[----------] 6 tests from EncryptionPolicyTest (9596 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:01 dist-test-slave-68xk krb5kdc[23296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:01 dist-test-slave-68xk krb5kdc[23296](info): set up 2 sockets
Aug 11 18:57:01 dist-test-slave-68xk krb5kdc[23296](info): commencing operation
krb5kdc: starting...
W20260811 18:57:02.810580 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:02 dist-test-slave-68xk krb5kdc[23296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:02.937737 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33809
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:03.023854 23321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:03.024091 23321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:03.024130 23321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:03.025272 23321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:03.025342 23321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:03.025369 23321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:03.025400 23321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:03.025426 23321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:03.026954 23321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33809
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:03.027235 23321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:03.027462 23321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:03.032425 23336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:03.032439 23330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:03.032444 23328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:03.032483 23321 server_base.cc:1034] running on GCE node
I20260811 18:57:03.033042 23321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:03.033380 23321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:03.034480 23321 hybrid_clock.cc:648] HybridClock initialized: now 1786474623034461 us; error 33 us; skew 500 ppm
Aug 11 18:57:03 dist-test-slave-68xk krb5kdc[23296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474623, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:03.041498 23321 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:03.041963 23321 webserver.cc:460] Webserver started at http://127.0.0.1:43371/ using document root <none> and password file <none>
I20260811 18:57:03.042194 23321 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:03.042241 23321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:03.042464 23321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:03.043540 23321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "848adef7f4f441c8b76b288707532f64"
format_stamp: "Formatted at 2026-08-11 18:57:03 on dist-test-slave-68xk"
server_key: "bddfd90649b7bebba5f53542bdce2852"
server_key_iv: "e385a7c03f9ac13c43e6148d137d227f"
server_key_version: "encryptionkey@0"
I20260811 18:57:03.043915 23321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "848adef7f4f441c8b76b288707532f64"
format_stamp: "Formatted at 2026-08-11 18:57:03 on dist-test-slave-68xk"
server_key: "bddfd90649b7bebba5f53542bdce2852"
server_key_iv: "e385a7c03f9ac13c43e6148d137d227f"
server_key_version: "encryptionkey@0"
I20260811 18:57:03.045287 23321 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:03.046139 23351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:03.046371 23321 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:03.046492 23321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "848adef7f4f441c8b76b288707532f64"
format_stamp: "Formatted at 2026-08-11 18:57:03 on dist-test-slave-68xk"
server_key: "bddfd90649b7bebba5f53542bdce2852"
server_key_iv: "e385a7c03f9ac13c43e6148d137d227f"
server_key_version: "encryptionkey@0"
I20260811 18:57:03.046577 23321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:03.061443 23321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:03.063654 23321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:03.063840 23321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:03.068177 23321 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33809
I20260811 18:57:03.068212 23435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33809 every 8 connection(s)
I20260811 18:57:03.068575 23321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:03.069613 23438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:03.072316 23438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64: Bootstrap starting.
I20260811 18:57:03.072916 23438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:03.073324 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 23321
I20260811 18:57:03.073324 23438 log.cc:824] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:03.073453 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:03.073702 24459 external_mini_cluster.cc:1428] Setting key 97f5f32c639d94918fdf1f6897e40278
I20260811 18:57:03.074263 23438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64: No bootstrap required, opened a new log
I20260811 18:57:03.076457 23438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848adef7f4f441c8b76b288707532f64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33809 } }
I20260811 18:57:03.076644 23438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:03.076687 23438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848adef7f4f441c8b76b288707532f64, State: Initialized, Role: FOLLOWER
I20260811 18:57:03.076828 23438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848adef7f4f441c8b76b288707532f64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33809 } }
I20260811 18:57:03.076925 23438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:03.076972 23438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:03.077026 23438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:03.077732 23438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848adef7f4f441c8b76b288707532f64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33809 } }
I20260811 18:57:03.077849 23438 leader_election.cc:302] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 848adef7f4f441c8b76b288707532f64; no voters:
I20260811 18:57:03.078003 23438 leader_election.cc:288] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:03.078109 23444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:03.078235 23438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:03.078262 23444 raft_consensus.cc:686] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [term 1 LEADER]: Becoming Leader. State: Replica: 848adef7f4f441c8b76b288707532f64, State: Running, Role: LEADER
I20260811 18:57:03.078359 23444 consensus_queue.cc:237] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848adef7f4f441c8b76b288707532f64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33809 } }
I20260811 18:57:03.078701 23444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 848adef7f4f441c8b76b288707532f64. Latest consensus state: current_term: 1 leader_uuid: "848adef7f4f441c8b76b288707532f64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848adef7f4f441c8b76b288707532f64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33809 } } }
I20260811 18:57:03.078800 23444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:03.078708 23446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "848adef7f4f441c8b76b288707532f64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "848adef7f4f441c8b76b288707532f64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33809 } } }
I20260811 18:57:03.078964 23446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:03.079102 23458 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:03.079680 23458 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:03.081888 23458 catalog_manager.cc:1347] Generated new cluster ID: 1e5615ae1af24cbeb1577d733336541b
I20260811 18:57:03.081949 23458 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:03 dist-test-slave-68xk krb5kdc[23296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:57:03.086992 23442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:03.074337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45647 (local address 127.0.0.1:33809)
0811 18:57:03.074588 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:03.074600 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:03.074637 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:57:03.075656 (+ 1019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:03.075666 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:03.075750 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:03.075903 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:03.076584 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:03.078327 (+ 1743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:03.079603 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:03.080353 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:03.080464 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:03.083360 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:03.083364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:03.083364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:03.083377 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:03.085144 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:03.085582 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:03.085585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:03.085586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:03.085674 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:03.085922 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:03.085924 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:03.085924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:03.086170 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:03.086365 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:03.086753 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 18:57:03.086838 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":143,"threads_started":1}
I20260811 18:57:03.087973 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:03.094159 23458 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:03.095029 23458 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:03.101471 23442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:03.090759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41063 (local address 127.0.0.1:33809)
0811 18:57:03.090800 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:03.090802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:03.094095 (+ 3293us) server_negotiation.cc:407] Connection header received
0811 18:57:03.094194 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:03.094195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:03.094206 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:03.094278 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:03.095018 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:03.095813 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:03.096794 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:03.097129 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:03.097200 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:03.098633 (+ 1433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:03.098634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:03.098635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:03.098649 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:03.100258 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:03.100680 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:03.100681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:03.100681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:03.100743 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:03.100970 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:03.100971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:03.100971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:03.101098 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:03.101203 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:03.101316 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 18:57:03.101381 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":21}
I20260811 18:57:03.113174 23458 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 848adef7f4f441c8b76b288707532f64: Generated new TSK 0
I20260811 18:57:03.113359 23458 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:03.115168 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 23321
W20260811 18:57:03.133807 23291 connection.cc:535] client connection to 127.0.0.1:33809 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33809): Connection reset by peer (error 104)
2026-08-11T18:57:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1630 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:03 dist-test-slave-68xk krb5kdc[23489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:03 dist-test-slave-68xk krb5kdc[23489](info): set up 2 sockets
Aug 11 18:57:03 dist-test-slave-68xk krb5kdc[23489](info): commencing operation
krb5kdc: starting...
W20260811 18:57:04.410789 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:04 dist-test-slave-68xk krb5kdc[23489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:04.537827 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35571
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:04.620537 23511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:04.620908 23511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:04.620996 23511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:04.622375 23511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:04.622478 23511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:04.622507 23511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:04.622540 23511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:04.622570 23511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:04.624292 23511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35571
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:04.624605 23511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:04.624874 23511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:04.630191 23520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:04.630183 23523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:04.630463 23511 server_base.cc:1034] running on GCE node
W20260811 18:57:04.630183 23526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:04.630820 23511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:04.631147 23511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:04.632340 23511 hybrid_clock.cc:648] HybridClock initialized: now 1786474624632323 us; error 31 us; skew 500 ppm
Aug 11 18:57:04 dist-test-slave-68xk krb5kdc[23489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474624, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:04.635043 23511 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:04.635510 23511 webserver.cc:460] Webserver started at http://127.0.0.1:38551/ using document root <none> and password file <none>
I20260811 18:57:04.635829 23511 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:04.635914 23511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:04.636063 23511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:04.637112 23511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "810d049585a14712b1d8a041abd81cb4"
format_stamp: "Formatted at 2026-08-11 18:57:04 on dist-test-slave-68xk"
server_key: "2ab05c203f40b67ee91b7a28672ba1d7"
server_key_iv: "0fdba10ce0faba7fd1894cc6a3997d8e"
server_key_version: "encryptionkey@0"
I20260811 18:57:04.637492 23511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "810d049585a14712b1d8a041abd81cb4"
format_stamp: "Formatted at 2026-08-11 18:57:04 on dist-test-slave-68xk"
server_key: "2ab05c203f40b67ee91b7a28672ba1d7"
server_key_iv: "0fdba10ce0faba7fd1894cc6a3997d8e"
server_key_version: "encryptionkey@0"
I20260811 18:57:04.638926 23511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:57:04.639735 23535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:04.639952 23511 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:04.640049 23511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "810d049585a14712b1d8a041abd81cb4"
format_stamp: "Formatted at 2026-08-11 18:57:04 on dist-test-slave-68xk"
server_key: "2ab05c203f40b67ee91b7a28672ba1d7"
server_key_iv: "0fdba10ce0faba7fd1894cc6a3997d8e"
server_key_version: "encryptionkey@0"
I20260811 18:57:04.640128 23511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:04.654527 23511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:04.656874 23511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:04.657039 23511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:04.661319 23511 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35571
I20260811 18:57:04.661355 23619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35571 every 8 connection(s)
I20260811 18:57:04.661742 23511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:04.662704 23625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:04.662952 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 23511
I20260811 18:57:04.663089 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:04.663303 24459 external_mini_cluster.cc:1428] Setting key 009a760a156a9c54c33150024d018bfd
I20260811 18:57:04.666285 23625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4: Bootstrap starting.
I20260811 18:57:04.667102 23625 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:04.667420 23625 log.cc:824] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:04.668308 23625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4: No bootstrap required, opened a new log
I20260811 18:57:04.669131 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:04.663869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47105 (local address 127.0.0.1:35571)
0811 18:57:04.664037 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:04.664045 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:04.664071 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:57:04.664524 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:04.664531 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:04.664580 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:04.664699 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:04.665000 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:04.665910 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:04.667035 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:04.667517 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:04.667606 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:04.668394 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:04.668399 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:04.668400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:04.668581 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:04.668612 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:04.668623 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:04.668693 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:04.668876 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 18:57:04.668910 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
I20260811 18:57:04.670399 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:04.670895 23625 raft_consensus.cc:348] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810d049585a14712b1d8a041abd81cb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35571 } }
I20260811 18:57:04.671116 23625 raft_consensus.cc:374] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:04.671155 23625 raft_consensus.cc:729] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810d049585a14712b1d8a041abd81cb4, State: Initialized, Role: FOLLOWER
I20260811 18:57:04.671291 23625 consensus_queue.cc:260] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810d049585a14712b1d8a041abd81cb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35571 } }
I20260811 18:57:04.671386 23625 raft_consensus.cc:388] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:04.671416 23625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:04.671465 23625 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:04.672324 23625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810d049585a14712b1d8a041abd81cb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35571 } }
I20260811 18:57:04.672446 23625 leader_election.cc:302] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 810d049585a14712b1d8a041abd81cb4; no voters:
I20260811 18:57:04.672624 23625 leader_election.cc:288] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:04.672676 23640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:04.672816 23640 raft_consensus.cc:686] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [term 1 LEADER]: Becoming Leader. State: Replica: 810d049585a14712b1d8a041abd81cb4, State: Running, Role: LEADER
I20260811 18:57:04.672902 23625 sys_catalog.cc:564] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:04.672971 23640 consensus_queue.cc:237] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810d049585a14712b1d8a041abd81cb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35571 } }
I20260811 18:57:04.673378 23640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 810d049585a14712b1d8a041abd81cb4. Latest consensus state: current_term: 1 leader_uuid: "810d049585a14712b1d8a041abd81cb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810d049585a14712b1d8a041abd81cb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35571 } } }
I20260811 18:57:04.673532 23640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:04.673960 23651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:04.674479 23643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "810d049585a14712b1d8a041abd81cb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810d049585a14712b1d8a041abd81cb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35571 } } }
I20260811 18:57:04.674553 23651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:04.674631 23643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:04.675901 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:04.672149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53357 (local address 127.0.0.1:35571)
0811 18:57:04.672189 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:04.672190 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:04.672267 (+ 77us) server_negotiation.cc:407] Connection header received
0811 18:57:04.672336 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:04.672336 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:04.672343 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:04.672389 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:04.672525 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:04.673230 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:04.674247 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:04.674597 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:04.674672 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:04.675518 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:04.675520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:04.675520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:04.675525 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:04.675539 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:04.675543 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:04.675590 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:04.675814 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 18:57:04.675824 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:57:04.676405 23651 catalog_manager.cc:1347] Generated new cluster ID: c7e1b968d787475496ccb20c41eb9d9d
I20260811 18:57:04.676450 23651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:04.688293 23651 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:04.688836 23651 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:04.693399 23651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 810d049585a14712b1d8a041abd81cb4: Generated new TSK 0
I20260811 18:57:04.693588 23651 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:04.698818 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 23511
W20260811 18:57:04.712563 23487 connection.cc:535] client connection to 127.0.0.1:35571 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35571): Connection reset by peer (error 104)
2026-08-11T18:57:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1578 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:04 dist-test-slave-68xk krb5kdc[23668](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:04 dist-test-slave-68xk krb5kdc[23668](info): set up 2 sockets
Aug 11 18:57:04 dist-test-slave-68xk krb5kdc[23668](info): commencing operation
krb5kdc: starting...
W20260811 18:57:05.962234 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:06 dist-test-slave-68xk krb5kdc[23668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:06.097268 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42555
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:06.185509 23691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:06.185768 23691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:06.185806 23691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:06.187006 23691 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:06.187076 23691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:06.187099 23691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:06.187120 23691 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:06.187153 23691 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:06.188654 23691 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42555
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:06.188931 23691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:06.189163 23691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:06.194199 23701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:06.194242 23706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:06.194286 23699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:06.194620 23691 server_base.cc:1034] running on GCE node
I20260811 18:57:06.194877 23691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:06.195227 23691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:06.196425 23691 hybrid_clock.cc:648] HybridClock initialized: now 1786474626196414 us; error 33 us; skew 500 ppm
Aug 11 18:57:06 dist-test-slave-68xk krb5kdc[23668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474626, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:06.199216 23691 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:06.199703 23691 webserver.cc:460] Webserver started at http://127.0.0.1:37153/ using document root <none> and password file <none>
I20260811 18:57:06.199965 23691 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:06.200035 23691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:06.200227 23691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:06.201431 23691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "2ea1bbfaabdd409bb39f2d74e2bec233"
format_stamp: "Formatted at 2026-08-11 18:57:06 on dist-test-slave-68xk"
server_key: "fe64c483cd6d51842e429d8ef1ab7afc"
server_key_iv: "62605dd74d59eb91b5ab23d22bafb9fc"
server_key_version: "encryptionkey@0"
I20260811 18:57:06.201927 23691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "2ea1bbfaabdd409bb39f2d74e2bec233"
format_stamp: "Formatted at 2026-08-11 18:57:06 on dist-test-slave-68xk"
server_key: "fe64c483cd6d51842e429d8ef1ab7afc"
server_key_iv: "62605dd74d59eb91b5ab23d22bafb9fc"
server_key_version: "encryptionkey@0"
I20260811 18:57:06.203477 23691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 18:57:06.204295 23717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:06.204542 23691 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:06.204655 23691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "2ea1bbfaabdd409bb39f2d74e2bec233"
format_stamp: "Formatted at 2026-08-11 18:57:06 on dist-test-slave-68xk"
server_key: "fe64c483cd6d51842e429d8ef1ab7afc"
server_key_iv: "62605dd74d59eb91b5ab23d22bafb9fc"
server_key_version: "encryptionkey@0"
I20260811 18:57:06.204743 23691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:06.208920 23691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:06.211129 23691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:06.211316 23691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:06.215471 23691 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42555
I20260811 18:57:06.215512 23803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42555 every 8 connection(s)
I20260811 18:57:06.215886 23691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:06.216967 23804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:06.219530 23804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233: Bootstrap starting.
I20260811 18:57:06.220111 23804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:06.220388 23804 log.cc:824] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:06.221096 23804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233: No bootstrap required, opened a new log
I20260811 18:57:06.222777 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 23691
I20260811 18:57:06.222918 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:06.223142 24459 external_mini_cluster.cc:1428] Setting key d44eeea9e7477bae0468b7a4db8150d6
I20260811 18:57:06.223299 23804 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea1bbfaabdd409bb39f2d74e2bec233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42555 } }
I20260811 18:57:06.223471 23804 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:06.223498 23804 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea1bbfaabdd409bb39f2d74e2bec233, State: Initialized, Role: FOLLOWER
I20260811 18:57:06.223658 23804 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea1bbfaabdd409bb39f2d74e2bec233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42555 } }
I20260811 18:57:06.223830 23804 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:06.223937 23804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:06.224015 23804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:06.225333 23804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea1bbfaabdd409bb39f2d74e2bec233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42555 } }
I20260811 18:57:06.225478 23804 leader_election.cc:302] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ea1bbfaabdd409bb39f2d74e2bec233; no voters:
I20260811 18:57:06.225666 23804 leader_election.cc:288] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:06.225708 23810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:06.225734 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.223767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54491 (local address 127.0.0.1:42555)
0811 18:57:06.223971 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.223978 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.224004 (+ 26us) server_negotiation.cc:407] Connection header received
0811 18:57:06.224162 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.224169 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.224200 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.224311 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:06.225169 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:06.225174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:06.225174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:06.225178 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:06.225220 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:06.225232 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:06.225302 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.225415 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.225498 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":108,"threads_started":1}
I20260811 18:57:06.225886 23810 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [term 1 LEADER]: Becoming Leader. State: Replica: 2ea1bbfaabdd409bb39f2d74e2bec233, State: Running, Role: LEADER
I20260811 18:57:06.225946 23804 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:06.225981 23810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea1bbfaabdd409bb39f2d74e2bec233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42555 } }
I20260811 18:57:06.226373 23810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ea1bbfaabdd409bb39f2d74e2bec233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea1bbfaabdd409bb39f2d74e2bec233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42555 } } }
I20260811 18:57:06.226588 23810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:06.226835 23810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ea1bbfaabdd409bb39f2d74e2bec233. Latest consensus state: current_term: 1 leader_uuid: "2ea1bbfaabdd409bb39f2d74e2bec233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea1bbfaabdd409bb39f2d74e2bec233" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42555 } } }
I20260811 18:57:06.226933 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:06.226962 23810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:06.227289 23828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:06.227839 23828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:06.229878 23828 catalog_manager.cc:1347] Generated new cluster ID: 5cb4acddb09c47db8bffa16cd9b1b0fc
I20260811 18:57:06.229939 23828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:06.230324 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:06.228889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51633 (local address 127.0.0.1:42555)
0811 18:57:06.228934 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:06.228936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:06.229087 (+ 151us) server_negotiation.cc:407] Connection header received
0811 18:57:06.229179 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:06.229180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:06.229187 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:06.229258 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:06.230056 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:06.230057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:06.230058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:06.230065 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:06.230084 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:06.230088 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:06.230156 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:06.230238 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 18:57:06.230254 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:57:06.239643 23828 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:06.239833 23828 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:06.247893 23828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ea1bbfaabdd409bb39f2d74e2bec233: Generated new TSK 0
I20260811 18:57:06.248108 23828 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:06.255788 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 23691
2026-08-11T18:57:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1556 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:06 dist-test-slave-68xk krb5kdc[23851](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:06 dist-test-slave-68xk krb5kdc[23851](info): set up 2 sockets
Aug 11 18:57:06 dist-test-slave-68xk krb5kdc[23851](info): commencing operation
krb5kdc: starting...
W20260811 18:57:07.516543 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:07 dist-test-slave-68xk krb5kdc[23851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:07.650014 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35807
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:07.734346 23880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:07.734619 23880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:07.734659 23880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:07.735834 23880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:07.735908 23880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:07.735934 23880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:07.735956 23880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:07.735985 23880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:07.737510 23880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:07.737807 23880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:07.738040 23880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:07.743032 23886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:07.743081 23889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:07.743139 23880 server_base.cc:1034] running on GCE node
W20260811 18:57:07.743033 23887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:07.743552 23880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:07.743867 23880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:07.745049 23880 hybrid_clock.cc:648] HybridClock initialized: now 1786474627745017 us; error 71 us; skew 500 ppm
Aug 11 18:57:07 dist-test-slave-68xk krb5kdc[23851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474627, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:07.747567 23880 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:07.748023 23880 webserver.cc:460] Webserver started at http://127.0.0.1:39021/ using document root <none> and password file <none>
I20260811 18:57:07.748270 23880 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:07.748340 23880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:07.748492 23880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:07.749555 23880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "86ef0d8126ae451880f66af2c1f65115"
format_stamp: "Formatted at 2026-08-11 18:57:07 on dist-test-slave-68xk"
server_key: "011745133b4d9869dad50b015040ff1b"
server_key_iv: "2aa0d35578f74b2a7969196a095ccbe6"
server_key_version: "encryptionkey@0"
I20260811 18:57:07.749936 23880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "86ef0d8126ae451880f66af2c1f65115"
format_stamp: "Formatted at 2026-08-11 18:57:07 on dist-test-slave-68xk"
server_key: "011745133b4d9869dad50b015040ff1b"
server_key_iv: "2aa0d35578f74b2a7969196a095ccbe6"
server_key_version: "encryptionkey@0"
I20260811 18:57:07.751405 23880 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:57:07.752151 23902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:07.752360 23880 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:07.752473 23880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "86ef0d8126ae451880f66af2c1f65115"
format_stamp: "Formatted at 2026-08-11 18:57:07 on dist-test-slave-68xk"
server_key: "011745133b4d9869dad50b015040ff1b"
server_key_iv: "2aa0d35578f74b2a7969196a095ccbe6"
server_key_version: "encryptionkey@0"
I20260811 18:57:07.752552 23880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:07.767017 23880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:07.769006 23880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:07.769188 23880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:07.773515 23880 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35807
I20260811 18:57:07.773566 23986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35807 every 8 connection(s)
I20260811 18:57:07.773974 23880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:07.775008 23989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:07.775768 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 23880
I20260811 18:57:07.775903 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:07.776088 24459 external_mini_cluster.cc:1428] Setting key 2b3d6f391167b243f0ff212b7a6ad531
I20260811 18:57:07.778170 23989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115: Bootstrap starting.
I20260811 18:57:07.778944 23989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:07.779273 23989 log.cc:824] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:07.780009 23989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115: No bootstrap required, opened a new log
I20260811 18:57:07.781860 23989 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ef0d8126ae451880f66af2c1f65115" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35807 } }
I20260811 18:57:07.782027 23989 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:07.782076 23989 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ef0d8126ae451880f66af2c1f65115, State: Initialized, Role: FOLLOWER
I20260811 18:57:07.782244 23989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ef0d8126ae451880f66af2c1f65115" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35807 } }
I20260811 18:57:07.782348 23989 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:07.782394 23989 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:07.782474 23989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:07.783068 23989 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ef0d8126ae451880f66af2c1f65115" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35807 } }
Aug 11 18:57:07 dist-test-slave-68xk krb5kdc[23851](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:57:07.783198 23989 leader_election.cc:302] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86ef0d8126ae451880f66af2c1f65115; no voters:
I20260811 18:57:07.783394 23989 leader_election.cc:288] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:07.783474 24002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:07.783633 24002 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [term 1 LEADER]: Becoming Leader. State: Replica: 86ef0d8126ae451880f66af2c1f65115, State: Running, Role: LEADER
I20260811 18:57:07.783689 23989 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:07.783730 24002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ef0d8126ae451880f66af2c1f65115" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35807 } }
I20260811 18:57:07.784108 24003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86ef0d8126ae451880f66af2c1f65115" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ef0d8126ae451880f66af2c1f65115" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35807 } } }
I20260811 18:57:07.784192 24003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:07.784346 24003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86ef0d8126ae451880f66af2c1f65115. Latest consensus state: current_term: 1 leader_uuid: "86ef0d8126ae451880f66af2c1f65115" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86ef0d8126ae451880f66af2c1f65115" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35807 } } }
I20260811 18:57:07.784401 24003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:07.784754 24009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:07.785312 24009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:07.787168 24009 catalog_manager.cc:1347] Generated new cluster ID: a7a44dc3dc4b47dbb978855f1fbf7b8c
I20260811 18:57:07.787227 24009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:07.788288 23999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:07.776638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46475 (local address 127.0.0.1:35807)
0811 18:57:07.776837 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:07.776846 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:07.776879 (+ 33us) server_negotiation.cc:407] Connection header received
0811 18:57:07.777401 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:07.777410 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:07.777478 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:07.777629 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:07.778259 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:07.779611 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:07.780494 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:07.780932 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:07.781058 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:07.783808 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:07.783812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:07.783812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:07.783826 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:07.786347 (+ 2521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:07.786873 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:07.786877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:07.786877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:07.786994 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:07.787242 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:07.787244 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:07.787244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:07.787562 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:07.787712 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:07.787923 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 18:57:07.788072 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
I20260811 18:57:07.791863 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:07.800797 23999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:07.793517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38061 (local address 127.0.0.1:35807)
0811 18:57:07.793564 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:07.793567 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:07.793655 (+ 88us) server_negotiation.cc:407] Connection header received
0811 18:57:07.793738 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:07.793739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:07.793749 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:07.793776 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:07.794498 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:07.795254 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:07.796240 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:07.796569 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:07.796605 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:07.798082 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:07.798084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:07.798084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:07.798091 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:07.799711 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:07.800055 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:07.800055 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:07.800056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:07.800103 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:07.800283 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:07.800283 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:07.800284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:07.800393 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:07.800457 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:07.800636 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 18:57:07.800707 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:57:07.833583 24009 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:07.834170 24009 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:07.842468 24009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86ef0d8126ae451880f66af2c1f65115: Generated new TSK 0
I20260811 18:57:07.842701 24009 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:07.855792 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 23880
2026-08-11T18:57:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1598 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:07 dist-test-slave-68xk krb5kdc[24043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:07 dist-test-slave-68xk krb5kdc[24043](info): set up 2 sockets
Aug 11 18:57:07 dist-test-slave-68xk krb5kdc[24043](info): commencing operation
krb5kdc: starting...
W20260811 18:57:09.195601 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:09 dist-test-slave-68xk krb5kdc[24043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:09.329104 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33027
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:09.415805 24065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:09.416028 24065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:09.416052 24065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:09.417253 24065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:09.417297 24065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:09.417312 24065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:09.417325 24065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:09.417338 24065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:09.418888 24065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:09.419147 24065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:09.419404 24065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:09.424476 24073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:09.424554 24072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:09.424470 24075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:09.424763 24065 server_base.cc:1034] running on GCE node
I20260811 18:57:09.425019 24065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:09.425319 24065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:09.426509 24065 hybrid_clock.cc:648] HybridClock initialized: now 1786474629426489 us; error 32 us; skew 500 ppm
Aug 11 18:57:09 dist-test-slave-68xk krb5kdc[24043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474629, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:09.432910 24065 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:09.433432 24065 webserver.cc:460] Webserver started at http://127.0.0.1:42001/ using document root <none> and password file <none>
I20260811 18:57:09.433676 24065 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:09.433730 24065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:09.433910 24065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:09.435137 24065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "13d8942db386498d973b870ed85f1572"
format_stamp: "Formatted at 2026-08-11 18:57:09 on dist-test-slave-68xk"
server_key: "6b2373c47201147468b42e1612764aae"
server_key_iv: "042a7b7335b570faa0e9ba28e55638d9"
server_key_version: "encryptionkey@0"
I20260811 18:57:09.435518 24065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "13d8942db386498d973b870ed85f1572"
format_stamp: "Formatted at 2026-08-11 18:57:09 on dist-test-slave-68xk"
server_key: "6b2373c47201147468b42e1612764aae"
server_key_iv: "042a7b7335b570faa0e9ba28e55638d9"
server_key_version: "encryptionkey@0"
I20260811 18:57:09.436941 24065 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:09.437732 24086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:09.437942 24065 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:09.438053 24065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "13d8942db386498d973b870ed85f1572"
format_stamp: "Formatted at 2026-08-11 18:57:09 on dist-test-slave-68xk"
server_key: "6b2373c47201147468b42e1612764aae"
server_key_iv: "042a7b7335b570faa0e9ba28e55638d9"
server_key_version: "encryptionkey@0"
I20260811 18:57:09.438140 24065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:09.450008 24065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:09.451990 24065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:09.452155 24065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:09.456545 24065 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33027
I20260811 18:57:09.456602 24165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33027 every 8 connection(s)
I20260811 18:57:09.456970 24065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:09.457942 24166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:09.460454 24166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572: Bootstrap starting.
I20260811 18:57:09.461066 24166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:09.461328 24166 log.cc:824] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:09.462077 24166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572: No bootstrap required, opened a new log
I20260811 18:57:09.463960 24166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d8942db386498d973b870ed85f1572" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33027 } }
I20260811 18:57:09.464114 24166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:09.464143 24166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d8942db386498d973b870ed85f1572, State: Initialized, Role: FOLLOWER
I20260811 18:57:09.464309 24166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d8942db386498d973b870ed85f1572" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33027 } }
I20260811 18:57:09.464406 24166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:09.464432 24166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:09.464475 24166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:09.465019 24166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d8942db386498d973b870ed85f1572" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33027 } }
I20260811 18:57:09.465176 24166 leader_election.cc:302] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13d8942db386498d973b870ed85f1572; no voters:
I20260811 18:57:09.465224 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24065
I20260811 18:57:09.465368 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:09.465407 24166 leader_election.cc:288] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:09.465449 24169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:09.465591 24459 external_mini_cluster.cc:1428] Setting key 410959ee582b3e5e429e043c385c6084
I20260811 18:57:09.465641 24169 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [term 1 LEADER]: Becoming Leader. State: Replica: 13d8942db386498d973b870ed85f1572, State: Running, Role: LEADER
I20260811 18:57:09.465799 24166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:09.466280 24169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d8942db386498d973b870ed85f1572" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33027 } }
I20260811 18:57:09.467062 24170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13d8942db386498d973b870ed85f1572. Latest consensus state: current_term: 1 leader_uuid: "13d8942db386498d973b870ed85f1572" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d8942db386498d973b870ed85f1572" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33027 } } }
I20260811 18:57:09.467173 24170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:09.467062 24173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13d8942db386498d973b870ed85f1572" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13d8942db386498d973b870ed85f1572" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33027 } } }
I20260811 18:57:09.467428 24173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572 [sys.catalog]: This master's current role is: LEADER
W20260811 18:57:09.468043 24196 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:09.468115 24196 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:57:09.468168 24192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:09.468331 24192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:09.470005 24192 catalog_manager.cc:1347] Generated new cluster ID: 297f4ef88f8f4b3ea3a7b9ac902c3bb5
I20260811 18:57:09.470111 24192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:09.472652 24182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:09.466604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35499 (local address 127.0.0.1:33027)
0811 18:57:09.466925 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:09.466936 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:09.466978 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:57:09.467132 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:09.467142 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:09.467216 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:09.467862 (+ 646us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:09.467986 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:09.469425 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:09.470326 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:09.470920 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:09.471066 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:09.471862 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:09.471867 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:09.471867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:09.472088 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:09.472122 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:09.472134 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:09.472224 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:09.472296 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 18:57:09.472476 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":174,"threads_started":1}
I20260811 18:57:09.473694 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:09.482086 24182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:09.478755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48967 (local address 127.0.0.1:33027)
0811 18:57:09.478816 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:09.478818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:09.479018 (+ 200us) server_negotiation.cc:407] Connection header received
0811 18:57:09.479117 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:09.479118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:09.479128 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:09.479209 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:09.479371 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:09.479893 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:09.480687 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:09.480965 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:09.481060 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:09.481816 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:09.481818 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:09.481818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:09.481823 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:09.481841 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:09.481846 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:09.481899 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:09.481963 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 18:57:09.481990 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:57:09.484354 24192 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:09.485028 24192 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:09.498642 24192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13d8942db386498d973b870ed85f1572: Generated new TSK 0
I20260811 18:57:09.498862 24192 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:09.501466 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24065
2026-08-11T18:57:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1646 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:09 dist-test-slave-68xk krb5kdc[24216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:09 dist-test-slave-68xk krb5kdc[24216](info): set up 2 sockets
Aug 11 18:57:09 dist-test-slave-68xk krb5kdc[24216](info): commencing operation
krb5kdc: starting...
W20260811 18:57:10.762804 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:10 dist-test-slave-68xk krb5kdc[24216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:10.894356 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44573
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:10.977746 24239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:10.977996 24239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:10.978036 24239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:10.979228 24239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:10.979308 24239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:10.979332 24239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:10.979353 24239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:10.979386 24239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:10.980875 24239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:10.981172 24239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:10.981411 24239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:10.986332 24247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:10.986353 24248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:10.986385 24239 server_base.cc:1034] running on GCE node
W20260811 18:57:10.986354 24251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:10.986853 24239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:10.987226 24239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:10.988400 24239 hybrid_clock.cc:648] HybridClock initialized: now 1786474630988395 us; error 39 us; skew 500 ppm
Aug 11 18:57:10 dist-test-slave-68xk krb5kdc[24216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474630, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:10.990998 24239 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:10.991456 24239 webserver.cc:460] Webserver started at http://127.0.0.1:38727/ using document root <none> and password file <none>
I20260811 18:57:10.991690 24239 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:10.991762 24239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:10.991916 24239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:10.992959 24239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "6450d0ba9eb94acca29274505dd7c6fa"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-68xk"
server_key: "1bf13349d09581842f1d4787c8d9c635"
server_key_iv: "e84118e726959a123d6ac9f2a8ceccea"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.993328 24239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "6450d0ba9eb94acca29274505dd7c6fa"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-68xk"
server_key: "1bf13349d09581842f1d4787c8d9c635"
server_key_iv: "e84118e726959a123d6ac9f2a8ceccea"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.994722 24239 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:57:10.995484 24267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:10.995645 24239 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:10.995752 24239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "6450d0ba9eb94acca29274505dd7c6fa"
format_stamp: "Formatted at 2026-08-11 18:57:10 on dist-test-slave-68xk"
server_key: "1bf13349d09581842f1d4787c8d9c635"
server_key_iv: "e84118e726959a123d6ac9f2a8ceccea"
server_key_version: "encryptionkey@0"
I20260811 18:57:10.995834 24239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:10.999194 24239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:11.001338 24239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:11.001514 24239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:11.006330 24239 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44573
I20260811 18:57:11.006378 24344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44573 every 8 connection(s)
I20260811 18:57:11.006867 24239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:11.009518 24345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:11.009693 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24239
I20260811 18:57:11.009864 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:11.010190 24459 external_mini_cluster.cc:1428] Setting key 31db1963fabfabae05376dade2f3ec1f
I20260811 18:57:11.013428 24345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa: Bootstrap starting.
I20260811 18:57:11.013693 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.011072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43057 (local address 127.0.0.1:44573)
0811 18:57:11.011419 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.011429 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.011464 (+ 35us) server_negotiation.cc:407] Connection header received
0811 18:57:11.012013 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.012024 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.012092 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.012252 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.013063 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.013067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.013067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:11.013072 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.013189 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:11.013209 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.013440 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.013471 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.013509 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":78,"threads_started":1}
I20260811 18:57:11.014186 24345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:11.014534 24345 log.cc:824] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:11.014958 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:11.015498 24345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa: No bootstrap required, opened a new log
I20260811 18:57:11.018108 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:11.016646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38581 (local address 127.0.0.1:44573)
0811 18:57:11.016707 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:11.016708 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:11.016883 (+ 175us) server_negotiation.cc:407] Connection header received
0811 18:57:11.016968 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:11.016969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:11.016975 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:11.017098 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:11.017768 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:11.017769 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:11.017770 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:11.017774 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:11.017788 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:11.017792 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:11.017868 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:11.017935 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 18:57:11.017950 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:57:11.017949 24345 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6450d0ba9eb94acca29274505dd7c6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44573 } }
I20260811 18:57:11.018215 24345 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:11.018278 24345 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6450d0ba9eb94acca29274505dd7c6fa, State: Initialized, Role: FOLLOWER
I20260811 18:57:11.018478 24345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6450d0ba9eb94acca29274505dd7c6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44573 } }
I20260811 18:57:11.018584 24345 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:11.018618 24345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:11.018684 24345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:11.019320 24345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6450d0ba9eb94acca29274505dd7c6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44573 } }
I20260811 18:57:11.019439 24345 leader_election.cc:302] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6450d0ba9eb94acca29274505dd7c6fa; no voters:
I20260811 18:57:11.019598 24345 leader_election.cc:288] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:11.019637 24359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:11.019801 24359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [term 1 LEADER]: Becoming Leader. State: Replica: 6450d0ba9eb94acca29274505dd7c6fa, State: Running, Role: LEADER
I20260811 18:57:11.019843 24345 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:11.019963 24359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6450d0ba9eb94acca29274505dd7c6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44573 } }
I20260811 18:57:11.020413 24360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6450d0ba9eb94acca29274505dd7c6fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6450d0ba9eb94acca29274505dd7c6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44573 } } }
I20260811 18:57:11.020414 24361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6450d0ba9eb94acca29274505dd7c6fa. Latest consensus state: current_term: 1 leader_uuid: "6450d0ba9eb94acca29274505dd7c6fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6450d0ba9eb94acca29274505dd7c6fa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44573 } } }
I20260811 18:57:11.020577 24360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:11.020674 24361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:11.020849 24371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:11.021416 24371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:11.022986 24371 catalog_manager.cc:1347] Generated new cluster ID: c2f1900c71ab48db98f88370ede443a2
I20260811 18:57:11.023044 24371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:11.049631 24371 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:11.049839 24371 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:11.060966 24371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6450d0ba9eb94acca29274505dd7c6fa: Generated new TSK 0
I20260811 18:57:11.061203 24371 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:11.064471 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24239
2026-08-11T18:57:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1563 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:11 dist-test-slave-68xk krb5kdc[24385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:11 dist-test-slave-68xk krb5kdc[24385](info): set up 2 sockets
Aug 11 18:57:11 dist-test-slave-68xk krb5kdc[24385](info): commencing operation
krb5kdc: starting...
W20260811 18:57:12.338152 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:12 dist-test-slave-68xk krb5kdc[24385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:12.469184 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43343
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43343
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:12.556059 24411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:12.556318 24411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:12.556360 24411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:12.557515 24411 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:12.557586 24411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:12.557610 24411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:12.557631 24411 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:12.557660 24411 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:12.559145 24411 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:12.559433 24411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:12.559671 24411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:12.564738 24418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:12.564700 24421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:12.564720 24423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:12.564744 24411 server_base.cc:1034] running on GCE node
I20260811 18:57:12.565196 24411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:12.565557 24411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:12.566738 24411 hybrid_clock.cc:648] HybridClock initialized: now 1786474632566707 us; error 65 us; skew 500 ppm
Aug 11 18:57:12 dist-test-slave-68xk krb5kdc[24385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474632, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:12.569437 24411 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:12.569921 24411 webserver.cc:460] Webserver started at http://127.0.0.1:45849/ using document root <none> and password file <none>
I20260811 18:57:12.570207 24411 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:12.570291 24411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:12.570495 24411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:12.571681 24411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "ea15a1d67db34705874eb12dfa1aa94c"
format_stamp: "Formatted at 2026-08-11 18:57:12 on dist-test-slave-68xk"
server_key: "bad2d348aa6985e593e83f904b0a9135"
server_key_iv: "d2bc449d34b1e8e125d99624bf3ec287"
server_key_version: "encryptionkey@0"
I20260811 18:57:12.572095 24411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "ea15a1d67db34705874eb12dfa1aa94c"
format_stamp: "Formatted at 2026-08-11 18:57:12 on dist-test-slave-68xk"
server_key: "bad2d348aa6985e593e83f904b0a9135"
server_key_iv: "d2bc449d34b1e8e125d99624bf3ec287"
server_key_version: "encryptionkey@0"
I20260811 18:57:12.573648 24411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:12.574738 24436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:12.574983 24411 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:12.575098 24411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "ea15a1d67db34705874eb12dfa1aa94c"
format_stamp: "Formatted at 2026-08-11 18:57:12 on dist-test-slave-68xk"
server_key: "bad2d348aa6985e593e83f904b0a9135"
server_key_iv: "d2bc449d34b1e8e125d99624bf3ec287"
server_key_version: "encryptionkey@0"
I20260811 18:57:12.575192 24411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:12.585072 24411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:12.587095 24411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:12.587255 24411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:12.591470 24411 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43343
I20260811 18:57:12.591502 24528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43343 every 8 connection(s)
I20260811 18:57:12.591862 24411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:12.592762 24530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:12.595091 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24411
I20260811 18:57:12.595176 24530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c: Bootstrap starting.
I20260811 18:57:12.595288 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:12.595481 24459 external_mini_cluster.cc:1428] Setting key 90f8f9628043afcfb9c215ba6120bb1f
I20260811 18:57:12.595985 24530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:12.596355 24530 log.cc:824] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:12.597146 24530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c: No bootstrap required, opened a new log
I20260811 18:57:12.599512 24530 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15a1d67db34705874eb12dfa1aa94c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43343 } }
I20260811 18:57:12.599643 24530 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:12.599666 24530 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea15a1d67db34705874eb12dfa1aa94c, State: Initialized, Role: FOLLOWER
I20260811 18:57:12.599799 24530 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15a1d67db34705874eb12dfa1aa94c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43343 } }
I20260811 18:57:12.599869 24530 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:12.599889 24530 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:12.599953 24530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:12.600585 24530 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15a1d67db34705874eb12dfa1aa94c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43343 } }
I20260811 18:57:12.600690 24530 leader_election.cc:302] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea15a1d67db34705874eb12dfa1aa94c; no voters:
I20260811 18:57:12.600850 24530 leader_election.cc:288] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:12.600908 24537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:12.601053 24537 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [term 1 LEADER]: Becoming Leader. State: Replica: ea15a1d67db34705874eb12dfa1aa94c, State: Running, Role: LEADER
I20260811 18:57:12.601114 24530 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:12.601223 24537 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15a1d67db34705874eb12dfa1aa94c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43343 } }
I20260811 18:57:12.601578 24537 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea15a1d67db34705874eb12dfa1aa94c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15a1d67db34705874eb12dfa1aa94c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43343 } } }
I20260811 18:57:12.601686 24537 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:12.601886 24537 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea15a1d67db34705874eb12dfa1aa94c. Latest consensus state: current_term: 1 leader_uuid: "ea15a1d67db34705874eb12dfa1aa94c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15a1d67db34705874eb12dfa1aa94c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43343 } } }
I20260811 18:57:12.601955 24552 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:12.602008 24537 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:12.602641 24552 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 18:57:12 dist-test-slave-68xk krb5kdc[24385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:57:12.604521 24552 catalog_manager.cc:1347] Generated new cluster ID: c7feb6262d0b4ef7bbae85f3eea1368f
I20260811 18:57:12.604575 24552 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:12.607394 24534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:12.596082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:59191 (local address 127.0.0.1:43343)
0811 18:57:12.596294 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:12.596304 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:12.596343 (+ 39us) server_negotiation.cc:407] Connection header received
0811 18:57:12.596946 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:12.596955 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:12.597030 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:12.597181 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:12.597843 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:12.599340 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:12.600301 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:12.600937 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:12.601083 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:12.604018 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:12.604022 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:12.604022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:12.604035 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:12.605827 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:12.606238 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:12.606241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:12.606242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:12.606334 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:12.606617 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:12.606618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:12.606618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:12.606847 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:12.607037 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:12.607124 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 18:57:12.607227 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":81,"threads_started":1}
I20260811 18:57:12.611407 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:12.617956 24552 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:12.618641 24552 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:12.619220 24534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:12.612810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:40763 (local address 127.0.0.1:43343)
0811 18:57:12.612893 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:12.612895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:12.612943 (+ 48us) server_negotiation.cc:407] Connection header received
0811 18:57:12.613013 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:12.613014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:12.613023 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:12.613062 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:12.613589 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:12.614080 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:12.614877 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:12.615134 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:12.615219 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:12.616413 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:12.616415 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:12.616415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:12.616423 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:12.618011 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:12.618385 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:12.618386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:12.618387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:12.618463 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:12.618670 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:12.618671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:12.618671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:12.618784 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:12.618897 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:12.619029 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 18:57:12.619095 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":64}
I20260811 18:57:12.627439 24552 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea15a1d67db34705874eb12dfa1aa94c: Generated new TSK 0
I20260811 18:57:12.627619 24552 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:12.630489 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24411
W20260811 18:57:12.649691 24383 connection.cc:535] client connection to 127.0.0.1:43343 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43343): Connection reset by peer (error 104)
2026-08-11T18:57:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1571 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:12 dist-test-slave-68xk krb5kdc[24588](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:12 dist-test-slave-68xk krb5kdc[24588](info): set up 2 sockets
Aug 11 18:57:12 dist-test-slave-68xk krb5kdc[24588](info): commencing operation
krb5kdc: starting...
W20260811 18:57:13.980978 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:14 dist-test-slave-68xk krb5kdc[24588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:14.110404 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34081
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:14.199256 24605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:14.199479 24605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:14.199504 24605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:14.200685 24605 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:14.200731 24605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:14.200747 24605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:14.200760 24605 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:14.200821 24605 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:14.202378 24605 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:14.202661 24605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:14.202911 24605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:14.208099 24614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:14.208099 24611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:14.208130 24612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:14.208186 24605 server_base.cc:1034] running on GCE node
I20260811 18:57:14.208570 24605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:14.208889 24605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:14.210040 24605 hybrid_clock.cc:648] HybridClock initialized: now 1786474634210020 us; error 36 us; skew 500 ppm
Aug 11 18:57:14 dist-test-slave-68xk krb5kdc[24588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474634, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:14.212574 24605 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:14.212965 24605 webserver.cc:460] Webserver started at http://127.0.0.1:45989/ using document root <none> and password file <none>
I20260811 18:57:14.213145 24605 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:14.213186 24605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:14.213277 24605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:14.214290 24605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "2db6d757594d4f768d2ad37fd7c8c3f8"
format_stamp: "Formatted at 2026-08-11 18:57:14 on dist-test-slave-68xk"
server_key: "5784247e05951d3406085a00eb0f7334"
server_key_iv: "630c8c6641dd4e1ad269fe18a133da31"
server_key_version: "encryptionkey@0"
I20260811 18:57:14.214679 24605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "2db6d757594d4f768d2ad37fd7c8c3f8"
format_stamp: "Formatted at 2026-08-11 18:57:14 on dist-test-slave-68xk"
server_key: "5784247e05951d3406085a00eb0f7334"
server_key_iv: "630c8c6641dd4e1ad269fe18a133da31"
server_key_version: "encryptionkey@0"
I20260811 18:57:14.215994 24605 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:14.216683 24626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:14.216871 24605 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:14.216967 24605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "2db6d757594d4f768d2ad37fd7c8c3f8"
format_stamp: "Formatted at 2026-08-11 18:57:14 on dist-test-slave-68xk"
server_key: "5784247e05951d3406085a00eb0f7334"
server_key_iv: "630c8c6641dd4e1ad269fe18a133da31"
server_key_version: "encryptionkey@0"
I20260811 18:57:14.217041 24605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:14.224781 24605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:14.227084 24605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:14.227272 24605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:14.231704 24605 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34081
I20260811 18:57:14.231745 24715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34081 every 8 connection(s)
I20260811 18:57:14.232136 24605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:14.233047 24717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:14.235435 24717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8: Bootstrap starting.
I20260811 18:57:14.236027 24717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:14.236197 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24605
I20260811 18:57:14.236357 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:14.236378 24717 log.cc:824] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:14.236559 24459 external_mini_cluster.cc:1428] Setting key 7dae0e542fbf371e2c22702ac125591e
I20260811 18:57:14.237389 24717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8: No bootstrap required, opened a new log
I20260811 18:57:14.240190 24717 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db6d757594d4f768d2ad37fd7c8c3f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34081 } }
I20260811 18:57:14.240389 24717 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:14.240433 24717 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db6d757594d4f768d2ad37fd7c8c3f8, State: Initialized, Role: FOLLOWER
I20260811 18:57:14.240626 24717 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db6d757594d4f768d2ad37fd7c8c3f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34081 } }
I20260811 18:57:14.240732 24717 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:14.240777 24717 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:14.240859 24717 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:14.241731 24717 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db6d757594d4f768d2ad37fd7c8c3f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34081 } }
I20260811 18:57:14.241864 24717 leader_election.cc:302] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2db6d757594d4f768d2ad37fd7c8c3f8; no voters:
I20260811 18:57:14.242058 24717 leader_election.cc:288] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:14.242087 24725 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:14.242303 24725 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [term 1 LEADER]: Becoming Leader. State: Replica: 2db6d757594d4f768d2ad37fd7c8c3f8, State: Running, Role: LEADER
I20260811 18:57:14.242434 24725 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db6d757594d4f768d2ad37fd7c8c3f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34081 } }
I20260811 18:57:14.242875 24723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:14.237133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:41847 (local address 127.0.0.1:34081)
0811 18:57:14.237319 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:14.237328 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:14.237362 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:57:14.237829 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:14.237836 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:14.237886 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:14.237997 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:14.238299 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:14.239245 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:14.240496 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:14.241100 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:14.241181 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:14.241967 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:14.241972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:14.241973 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:14.242208 (+ 235us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:14.242250 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:14.242268 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:14.242359 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:14.242594 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 18:57:14.242624 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":99,"threads_started":1}
I20260811 18:57:14.242399 24717 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:14.243021 24729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2db6d757594d4f768d2ad37fd7c8c3f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db6d757594d4f768d2ad37fd7c8c3f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34081 } } }
I20260811 18:57:14.242901 24731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2db6d757594d4f768d2ad37fd7c8c3f8. Latest consensus state: current_term: 1 leader_uuid: "2db6d757594d4f768d2ad37fd7c8c3f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2db6d757594d4f768d2ad37fd7c8c3f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34081 } } }
I20260811 18:57:14.243244 24731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:14.243165 24729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:14.243538 24734 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:14.243963 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:14.244207 24734 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:14.246094 24734 catalog_manager.cc:1347] Generated new cluster ID: 701c1de6acde46a59dba0e74342f0207
I20260811 18:57:14.246165 24734 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:14.249938 24723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:14.245655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:57191 (local address 127.0.0.1:34081)
0811 18:57:14.245688 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:14.245690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:14.246498 (+ 808us) server_negotiation.cc:407] Connection header received
0811 18:57:14.246576 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:14.246577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:14.246587 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:14.246641 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:14.246788 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:14.247494 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:14.248568 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:14.248883 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:14.248958 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:14.249670 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:14.249671 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:14.249672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:14.249676 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:14.249693 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:14.249697 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:14.249771 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:14.249845 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 18:57:14.249856 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:57:14.268312 24734 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:14.269028 24734 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:14.274111 24734 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2db6d757594d4f768d2ad37fd7c8c3f8: Generated new TSK 0
I20260811 18:57:14.274329 24734 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:14.283185 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24605
W20260811 18:57:14.298271 24586 connection.cc:535] client connection to 127.0.0.1:34081 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34081): Connection reset by peer (error 104)
2026-08-11T18:57:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1648 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:14 dist-test-slave-68xk krb5kdc[24772](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:14 dist-test-slave-68xk krb5kdc[24772](info): set up 2 sockets
Aug 11 18:57:14 dist-test-slave-68xk krb5kdc[24772](info): commencing operation
krb5kdc: starting...
W20260811 18:57:15.559602 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:15 dist-test-slave-68xk krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:15.689642 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33421
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:15.775381 24789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:15.775632 24789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:15.775655 24789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:15.776783 24789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:15.776825 24789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:15.776839 24789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:15.776852 24789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:15.776865 24789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:15.778369 24789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:15.778641 24789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:15.778884 24789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:15.783861 24798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:15.783857 24803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:15.784042 24799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:15.784129 24789 server_base.cc:1034] running on GCE node
I20260811 18:57:15.784422 24789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:15.784727 24789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:15.785907 24789 hybrid_clock.cc:648] HybridClock initialized: now 1786474635785884 us; error 41 us; skew 500 ppm
Aug 11 18:57:15 dist-test-slave-68xk krb5kdc[24772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474635, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:15.788589 24789 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:15.789041 24789 webserver.cc:460] Webserver started at http://127.0.0.1:38539/ using document root <none> and password file <none>
I20260811 18:57:15.789291 24789 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:15.789363 24789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:15.789520 24789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:15.790716 24789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "0279132314244b819ea2b48dee3bfe50"
format_stamp: "Formatted at 2026-08-11 18:57:15 on dist-test-slave-68xk"
server_key: "ea08d4ba9495e0eb437a6f6a435c071d"
server_key_iv: "90472c58637e032f508066ad7d8f70ea"
server_key_version: "encryptionkey@0"
I20260811 18:57:15.791090 24789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "0279132314244b819ea2b48dee3bfe50"
format_stamp: "Formatted at 2026-08-11 18:57:15 on dist-test-slave-68xk"
server_key: "ea08d4ba9495e0eb437a6f6a435c071d"
server_key_iv: "90472c58637e032f508066ad7d8f70ea"
server_key_version: "encryptionkey@0"
I20260811 18:57:15.792495 24789 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:15.793315 24815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:15.793488 24789 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:15.793601 24789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "0279132314244b819ea2b48dee3bfe50"
format_stamp: "Formatted at 2026-08-11 18:57:15 on dist-test-slave-68xk"
server_key: "ea08d4ba9495e0eb437a6f6a435c071d"
server_key_iv: "90472c58637e032f508066ad7d8f70ea"
server_key_version: "encryptionkey@0"
I20260811 18:57:15.793684 24789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:15.797101 24789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:15.799067 24789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:15.799226 24789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:15.803279 24789 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33421
I20260811 18:57:15.803316 24899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33421 every 8 connection(s)
I20260811 18:57:15.803663 24789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:15.804694 24900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:15.805346 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24789
I20260811 18:57:15.805492 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:15.805694 24459 external_mini_cluster.cc:1428] Setting key c022fe90bebfcac16950454069762d37
I20260811 18:57:15.807914 24900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50: Bootstrap starting.
I20260811 18:57:15.808444 24907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:15.806223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:51147 (local address 127.0.0.1:33421)
0811 18:57:15.806459 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:15.806469 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:15.806503 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:57:15.807056 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:15.807065 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:15.807103 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:15.807252 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:15.807928 (+ 676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:15.807932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:15.807933 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:15.807938 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:15.807980 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:15.807994 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:15.808066 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:15.808175 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 18:57:15.808263 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":92,"threads_started":1}
I20260811 18:57:15.808645 24900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:15.808977 24900 log.cc:824] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:15.809607 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:15.809801 24900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50: No bootstrap required, opened a new log
I20260811 18:57:15.812145 24907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:15.811067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:44615 (local address 127.0.0.1:33421)
0811 18:57:15.811099 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:15.811101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:15.811229 (+ 128us) server_negotiation.cc:407] Connection header received
0811 18:57:15.811278 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:15.811278 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:15.811282 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:15.811320 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:15.811936 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:15.811937 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:15.811937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:15.811940 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:15.811952 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:15.811955 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:15.812000 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:15.812053 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 18:57:15.812063 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 18:57:15.812320 24900 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279132314244b819ea2b48dee3bfe50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33421 } }
I20260811 18:57:15.812495 24900 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:15.812546 24900 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0279132314244b819ea2b48dee3bfe50, State: Initialized, Role: FOLLOWER
I20260811 18:57:15.812673 24900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279132314244b819ea2b48dee3bfe50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33421 } }
I20260811 18:57:15.812768 24900 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:15.812793 24900 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:15.812820 24900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:15.813298 24900 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279132314244b819ea2b48dee3bfe50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33421 } }
I20260811 18:57:15.813382 24900 leader_election.cc:302] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0279132314244b819ea2b48dee3bfe50; no voters:
I20260811 18:57:15.813504 24900 leader_election.cc:288] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:15.813560 24917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:15.813738 24917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [term 1 LEADER]: Becoming Leader. State: Replica: 0279132314244b819ea2b48dee3bfe50, State: Running, Role: LEADER
I20260811 18:57:15.813761 24900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:15.813932 24917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279132314244b819ea2b48dee3bfe50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33421 } }
I20260811 18:57:15.814327 24917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0279132314244b819ea2b48dee3bfe50. Latest consensus state: current_term: 1 leader_uuid: "0279132314244b819ea2b48dee3bfe50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279132314244b819ea2b48dee3bfe50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33421 } } }
I20260811 18:57:15.814338 24919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0279132314244b819ea2b48dee3bfe50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279132314244b819ea2b48dee3bfe50" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33421 } } }
I20260811 18:57:15.814442 24917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:15.814493 24919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:15.814985 24931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:15.815514 24931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:15.816988 24931 catalog_manager.cc:1347] Generated new cluster ID: 342d542219574d7ba5b773eaf02e5f34
I20260811 18:57:15.817044 24931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:15.823278 24931 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:15.823468 24931 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:15.825939 24931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0279132314244b819ea2b48dee3bfe50: Generated new TSK 0
I20260811 18:57:15.826120 24931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:15.831075 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24789
2026-08-11T18:57:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1550 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:15 dist-test-slave-68xk krb5kdc[24950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:15 dist-test-slave-68xk krb5kdc[24950](info): set up 2 sockets
Aug 11 18:57:15 dist-test-slave-68xk krb5kdc[24950](info): commencing operation
krb5kdc: starting...
W20260811 18:57:17.093156 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:17 dist-test-slave-68xk krb5kdc[24950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:17.223611 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36725
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:17.309473 24976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:17.309733 24976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:17.309772 24976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:17.310981 24976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:17.311074 24976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:17.311117 24976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:17.311148 24976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:17.311172 24976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:17.312762 24976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36725
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:17.313068 24976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:17.313318 24976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:17.318298 24986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:17.318257 24988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:17.318274 24990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:17.318739 24976 server_base.cc:1034] running on GCE node
I20260811 18:57:17.318953 24976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:17.319218 24976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:17.320381 24976 hybrid_clock.cc:648] HybridClock initialized: now 1786474637320345 us; error 55 us; skew 500 ppm
Aug 11 18:57:17 dist-test-slave-68xk krb5kdc[24950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:17.323051 24976 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:17.323537 24976 webserver.cc:460] Webserver started at http://127.0.0.1:46011/ using document root <none> and password file <none>
I20260811 18:57:17.323817 24976 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:17.323865 24976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:17.324005 24976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:17.325122 24976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "c732f92553b640e98fb01e18267c7310"
format_stamp: "Formatted at 2026-08-11 18:57:17 on dist-test-slave-68xk"
server_key: "49079519ab96f8c2048cbd31aa3e2955"
server_key_iv: "3875e48fab5a119870f0e0ffc6ffa66f"
server_key_version: "encryptionkey@0"
I20260811 18:57:17.325500 24976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "c732f92553b640e98fb01e18267c7310"
format_stamp: "Formatted at 2026-08-11 18:57:17 on dist-test-slave-68xk"
server_key: "49079519ab96f8c2048cbd31aa3e2955"
server_key_iv: "3875e48fab5a119870f0e0ffc6ffa66f"
server_key_version: "encryptionkey@0"
I20260811 18:57:17.327179 24976 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 18:57:17.328117 25003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:17.328394 24976 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:17.328511 24976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "c732f92553b640e98fb01e18267c7310"
format_stamp: "Formatted at 2026-08-11 18:57:17 on dist-test-slave-68xk"
server_key: "49079519ab96f8c2048cbd31aa3e2955"
server_key_iv: "3875e48fab5a119870f0e0ffc6ffa66f"
server_key_version: "encryptionkey@0"
I20260811 18:57:17.328591 24976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:17.347800 24976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:17.349787 24976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:17.349946 24976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:17.354532 24976 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36725
I20260811 18:57:17.354578 25082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36725 every 8 connection(s)
I20260811 18:57:17.354965 24976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:17.355883 25083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:17.358260 25083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310: Bootstrap starting.
I20260811 18:57:17.358932 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 24976
I20260811 18:57:17.359032 25083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:17.359072 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:17.359268 24459 external_mini_cluster.cc:1428] Setting key 632dbf3381bcd2e82ea6971b8014037f
I20260811 18:57:17.359365 25083 log.cc:824] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:17.360217 25083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310: No bootstrap required, opened a new log
I20260811 18:57:17.362317 25083 raft_consensus.cc:348] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c732f92553b640e98fb01e18267c7310" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36725 } }
I20260811 18:57:17.362526 25083 raft_consensus.cc:374] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:17.362556 25083 raft_consensus.cc:729] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c732f92553b640e98fb01e18267c7310, State: Initialized, Role: FOLLOWER
I20260811 18:57:17.362731 25083 consensus_queue.cc:260] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c732f92553b640e98fb01e18267c7310" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36725 } }
I20260811 18:57:17.362823 25083 raft_consensus.cc:388] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:17.362857 25083 raft_consensus.cc:482] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:17.362905 25083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:17.363636 25083 raft_consensus.cc:504] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c732f92553b640e98fb01e18267c7310" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36725 } }
I20260811 18:57:17.363785 25083 leader_election.cc:302] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c732f92553b640e98fb01e18267c7310; no voters:
I20260811 18:57:17.363991 25083 leader_election.cc:288] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:17.364039 25096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:17.364267 25083 sys_catalog.cc:564] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:17.364279 25096 raft_consensus.cc:686] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [term 1 LEADER]: Becoming Leader. State: Replica: c732f92553b640e98fb01e18267c7310, State: Running, Role: LEADER
I20260811 18:57:17.364408 25096 consensus_queue.cc:237] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c732f92553b640e98fb01e18267c7310" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36725 } }
I20260811 18:57:17.364809 25100 sys_catalog.cc:455] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c732f92553b640e98fb01e18267c7310. Latest consensus state: current_term: 1 leader_uuid: "c732f92553b640e98fb01e18267c7310" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c732f92553b640e98fb01e18267c7310" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36725 } } }
I20260811 18:57:17.364954 25100 sys_catalog.cc:458] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:17.365474 25108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:17.365753 25098 sys_catalog.cc:455] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c732f92553b640e98fb01e18267c7310" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c732f92553b640e98fb01e18267c7310" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36725 } } }
I20260811 18:57:17.366065 25098 sys_catalog.cc:458] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:17.366484 25108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 18:57:17 dist-test-slave-68xk krb5kdc[24950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 18:57:17.368217 25108 catalog_manager.cc:1347] Generated new cluster ID: 221f27cb3b2b4c60ba42c58ced5aa36b
I20260811 18:57:17.368300 25108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:17.371568 25095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:17.359866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:59969 (local address 127.0.0.1:36725)
0811 18:57:17.360068 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:17.360077 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:17.360137 (+ 60us) server_negotiation.cc:407] Connection header received
0811 18:57:17.360628 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:17.360635 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:17.360690 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:17.360847 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:17.361533 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:17.362549 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:17.363692 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:17.364400 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:17.364556 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:17.367796 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:17.367800 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:17.367800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:17.367812 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:17.369785 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:17.370277 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:17.370281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:17.370281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:17.370384 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:17.370670 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:17.370671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:17.370672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:17.370958 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:17.371111 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:17.371262 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 18:57:17.371356 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260811 18:57:17.373124 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:17.381963 25095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:17.374728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:52205 (local address 127.0.0.1:36725)
0811 18:57:17.374767 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:17.374769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:17.374901 (+ 132us) server_negotiation.cc:407] Connection header received
0811 18:57:17.374931 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:17.374932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:17.374942 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:17.375011 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:17.375597 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:17.376375 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:17.377332 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:17.377673 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:17.377749 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:17.379074 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:17.379075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:17.379076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:17.379083 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:17.380664 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:17.381123 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:17.381124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:17.381125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:17.381185 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:17.381420 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:17.381421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:17.381421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:17.381550 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:17.381656 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:17.381806 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 18:57:17.381871 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:17.385514 25108 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:17.386303 25108 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:17.396210 25108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c732f92553b640e98fb01e18267c7310: Generated new TSK 0
I20260811 18:57:17.396450 25108 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:17.399433 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 24976
W20260811 18:57:17.413161 24946 connection.cc:535] client connection to 127.0.0.1:36725 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36725): Connection reset by peer (error 104)
2026-08-11T18:57:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1564 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:17 dist-test-slave-68xk krb5kdc[25140](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:17 dist-test-slave-68xk krb5kdc[25140](info): set up 2 sockets
Aug 11 18:57:17 dist-test-slave-68xk krb5kdc[25140](info): commencing operation
krb5kdc: starting...
W20260811 18:57:18.675503 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:18 dist-test-slave-68xk krb5kdc[25140](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:18.802153 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34521
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:18.885003 25160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:18.885275 25160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:18.885315 25160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:18.886495 25160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:18.886561 25160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:18.886584 25160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:18.886605 25160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:18.886633 25160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:18.888157 25160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34521
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:18.888453 25160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:18.888697 25160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:18.893798 25174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:18.893777 25170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:18.893821 25171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:18.894109 25160 server_base.cc:1034] running on GCE node
I20260811 18:57:18.894395 25160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:18.894796 25160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:18.895984 25160 hybrid_clock.cc:648] HybridClock initialized: now 1786474638895964 us; error 47 us; skew 500 ppm
Aug 11 18:57:18 dist-test-slave-68xk krb5kdc[25140](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474638, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:18.898691 25160 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:18.899135 25160 webserver.cc:460] Webserver started at http://127.0.0.1:38415/ using document root <none> and password file <none>
I20260811 18:57:18.899402 25160 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:18.899474 25160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:18.899664 25160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:18.900753 25160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "3d55d3ecc22846c2af9d7500e62568a7"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-68xk"
server_key: "7c8a49d8d5cb42182fea996885ae3b2d"
server_key_iv: "bd9e741ab2a1431ed3aeb37bc56b71be"
server_key_version: "encryptionkey@0"
I20260811 18:57:18.901124 25160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "3d55d3ecc22846c2af9d7500e62568a7"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-68xk"
server_key: "7c8a49d8d5cb42182fea996885ae3b2d"
server_key_iv: "bd9e741ab2a1431ed3aeb37bc56b71be"
server_key_version: "encryptionkey@0"
I20260811 18:57:18.902562 25160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 18:57:18.903375 25183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:18.903553 25160 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:18.903658 25160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "3d55d3ecc22846c2af9d7500e62568a7"
format_stamp: "Formatted at 2026-08-11 18:57:18 on dist-test-slave-68xk"
server_key: "7c8a49d8d5cb42182fea996885ae3b2d"
server_key_iv: "bd9e741ab2a1431ed3aeb37bc56b71be"
server_key_version: "encryptionkey@0"
I20260811 18:57:18.903746 25160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:18.926474 25160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:18.928685 25160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:18.928880 25160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:18.933176 25160 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34521
I20260811 18:57:18.933215 25269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34521 every 8 connection(s)
I20260811 18:57:18.933635 25160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:18.934661 25270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:18.936996 25270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7: Bootstrap starting.
I20260811 18:57:18.937654 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25160
I20260811 18:57:18.937665 25270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:18.937809 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:18.938011 24459 external_mini_cluster.cc:1428] Setting key 56a063f2ffe1683205c0b342af841107
I20260811 18:57:18.938038 25270 log.cc:824] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:18.938956 25270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7: No bootstrap required, opened a new log
I20260811 18:57:18.941699 25270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d55d3ecc22846c2af9d7500e62568a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34521 } }
I20260811 18:57:18.941833 25270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:18.941856 25270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d55d3ecc22846c2af9d7500e62568a7, State: Initialized, Role: FOLLOWER
I20260811 18:57:18.941991 25270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d55d3ecc22846c2af9d7500e62568a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34521 } }
I20260811 18:57:18.942062 25270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:18.942121 25270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:18.942170 25270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:18.942888 25270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d55d3ecc22846c2af9d7500e62568a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34521 } }
I20260811 18:57:18.943005 25270 leader_election.cc:302] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d55d3ecc22846c2af9d7500e62568a7; no voters:
I20260811 18:57:18.943166 25270 leader_election.cc:288] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:18.943204 25282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:18.943423 25282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [term 1 LEADER]: Becoming Leader. State: Replica: 3d55d3ecc22846c2af9d7500e62568a7, State: Running, Role: LEADER
I20260811 18:57:18.943594 25282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d55d3ecc22846c2af9d7500e62568a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34521 } }
I20260811 18:57:18.943756 25270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:18.943928 25282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d55d3ecc22846c2af9d7500e62568a7. Latest consensus state: current_term: 1 leader_uuid: "3d55d3ecc22846c2af9d7500e62568a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d55d3ecc22846c2af9d7500e62568a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34521 } } }
I20260811 18:57:18.943945 25283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d55d3ecc22846c2af9d7500e62568a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d55d3ecc22846c2af9d7500e62568a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34521 } } }
I20260811 18:57:18.944064 25282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:18.944085 25283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:18.944515 25286 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:18.944571 25279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:18.938587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:36993 (local address 127.0.0.1:34521)
0811 18:57:18.938908 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:18.938918 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:18.938952 (+ 34us) server_negotiation.cc:407] Connection header received
0811 18:57:18.939507 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:18.939516 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:18.939581 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:18.939734 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:18.939918 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:18.941311 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:18.942233 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:18.942875 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:18.943003 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:18.943814 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:18.943819 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:18.943820 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:18.944039 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:18.944082 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:18.944098 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:18.944168 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:18.944320 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 18:57:18.944355 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":110,"threads_started":1}
I20260811 18:57:18.945420 25286 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:18.945616 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:18.947163 25286 catalog_manager.cc:1347] Generated new cluster ID: 8cbc763e790f42d1b8435b8f24e0e4d8
I20260811 18:57:18.947221 25286 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:18.958446 25279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:18.954735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:52303 (local address 127.0.0.1:34521)
0811 18:57:18.954800 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:18.954803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:18.954917 (+ 114us) server_negotiation.cc:407] Connection header received
0811 18:57:18.954983 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:18.954984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:18.954996 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:18.955072 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:18.955236 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:18.955974 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:18.957011 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:18.957326 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:18.957392 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:18.958162 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:18.958163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:18.958163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:18.958167 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:18.958183 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:18.958187 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:18.958243 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:18.958330 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 18:57:18.958341 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:57:18.960618 25286 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:18.961318 25286 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:18.969795 25286 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d55d3ecc22846c2af9d7500e62568a7: Generated new TSK 0
I20260811 18:57:18.969996 25286 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:18.978344 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25160
W20260811 18:57:18.998744 25138 connection.cc:535] client connection to 127.0.0.1:34521 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34521): Connection reset by peer (error 104)
2026-08-11T18:57:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1586 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:19 dist-test-slave-68xk krb5kdc[25326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:19 dist-test-slave-68xk krb5kdc[25326](info): set up 2 sockets
Aug 11 18:57:19 dist-test-slave-68xk krb5kdc[25326](info): commencing operation
krb5kdc: starting...
W20260811 18:57:20.628126 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.615s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:20 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 18:57:20.838341 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40091
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:21.030537 25351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:21.030963 25351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:21.031105 25351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:21.033502 25351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:21.033661 25351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:21.033802 25351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:21.033864 25351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:21.033915 25351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:21.037209 25351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40091
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:21.038698 25351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:21.039594 25351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:21.048619 25362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:21.048573 25361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:21.048883 25366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:21.049206 25351 server_base.cc:1034] running on GCE node
I20260811 18:57:21.049655 25351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:21.050454 25351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:21.051652 25351 hybrid_clock.cc:648] HybridClock initialized: now 1786474641051615 us; error 64 us; skew 500 ppm
Aug 11 18:57:21 dist-test-slave-68xk krb5kdc[25326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474641, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:21.063161 25351 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 18:57:21.064281 25351 webserver.cc:460] Webserver started at http://127.0.0.1:35941/ using document root <none> and password file <none>
I20260811 18:57:21.064957 25351 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:21.065150 25351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:21.065702 25351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:21.069658 25351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4"
format_stamp: "Formatted at 2026-08-11 18:57:21 on dist-test-slave-68xk"
server_key: "a744dba1e49c9fac55f94929b95f381a"
server_key_iv: "7250008ad4ad5deb806e33567576f4af"
server_key_version: "encryptionkey@0"
I20260811 18:57:21.070763 25351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4"
format_stamp: "Formatted at 2026-08-11 18:57:21 on dist-test-slave-68xk"
server_key: "a744dba1e49c9fac55f94929b95f381a"
server_key_iv: "7250008ad4ad5deb806e33567576f4af"
server_key_version: "encryptionkey@0"
I20260811 18:57:21.073827 25351 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 18:57:21.075582 25375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:21.075870 25351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:21.076094 25351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4"
format_stamp: "Formatted at 2026-08-11 18:57:21 on dist-test-slave-68xk"
server_key: "a744dba1e49c9fac55f94929b95f381a"
server_key_iv: "7250008ad4ad5deb806e33567576f4af"
server_key_version: "encryptionkey@0"
I20260811 18:57:21.076246 25351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:21.083643 25351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:21.087838 25351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:21.088140 25351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:21.098253 25351 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40091
I20260811 18:57:21.098583 25460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40091 every 8 connection(s)
I20260811 18:57:21.099121 25351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:21.100981 25461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:21.101439 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25351
I20260811 18:57:21.101660 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:21.102003 24459 external_mini_cluster.cc:1428] Setting key 8d6ef18bceb6b5867fd3630393751230
I20260811 18:57:21.108058 25461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4: Bootstrap starting.
I20260811 18:57:21.108502 25467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:21.103115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:33989 (local address 127.0.0.1:40091)
0811 18:57:21.103432 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:21.103459 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:21.103511 (+ 52us) server_negotiation.cc:407] Connection header received
0811 18:57:21.104621 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:21.104639 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:21.104798 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:21.105245 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:21.107651 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:21.107657 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:21.107657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:21.107673 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:21.107789 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:21.107826 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:21.107963 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:21.108086 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 18:57:21.108149 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":144,"threads_started":1}
I20260811 18:57:21.109437 25461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:21.110036 25461 log.cc:824] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:21.110526 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:21.111385 25461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4: No bootstrap required, opened a new log
I20260811 18:57:21.114943 25467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:21.112938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:36493 (local address 127.0.0.1:40091)
0811 18:57:21.113011 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:21.113022 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:21.113204 (+ 182us) server_negotiation.cc:407] Connection header received
0811 18:57:21.113423 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:21.113423 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:21.113428 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:21.113513 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:21.114572 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:21.114573 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:21.114574 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:21.114579 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:21.114601 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:21.114607 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:21.114677 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:21.114781 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 18:57:21.114801 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 18:57:21.117290 25461 raft_consensus.cc:348] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40091 } }
I20260811 18:57:21.117576 25461 raft_consensus.cc:374] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:21.117699 25461 raft_consensus.cc:729] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f90b7d99f8e64ac9a71f90c8ff6918e4, State: Initialized, Role: FOLLOWER
I20260811 18:57:21.117976 25461 consensus_queue.cc:260] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40091 } }
I20260811 18:57:21.118153 25461 raft_consensus.cc:388] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:21.118283 25461 raft_consensus.cc:482] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:21.118455 25461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:21.119803 25461 raft_consensus.cc:504] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40091 } }
I20260811 18:57:21.120029 25461 leader_election.cc:302] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f90b7d99f8e64ac9a71f90c8ff6918e4; no voters:
I20260811 18:57:21.120397 25461 leader_election.cc:288] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:21.120522 25478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:21.120816 25478 raft_consensus.cc:686] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [term 1 LEADER]: Becoming Leader. State: Replica: f90b7d99f8e64ac9a71f90c8ff6918e4, State: Running, Role: LEADER
I20260811 18:57:21.120968 25461 sys_catalog.cc:564] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:21.120995 25478 consensus_queue.cc:237] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40091 } }
I20260811 18:57:21.121826 25480 sys_catalog.cc:455] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f90b7d99f8e64ac9a71f90c8ff6918e4. Latest consensus state: current_term: 1 leader_uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40091 } } }
I20260811 18:57:21.121796 25479 sys_catalog.cc:455] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90b7d99f8e64ac9a71f90c8ff6918e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40091 } } }
I20260811 18:57:21.122045 25480 sys_catalog.cc:458] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:21.122057 25479 sys_catalog.cc:458] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:21.123042 25495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:21.124249 25495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:21.128367 25495 catalog_manager.cc:1347] Generated new cluster ID: 18106ca931df4b5cab76d699b84681b4
I20260811 18:57:21.128482 25495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:21.141815 25495 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:21.142198 25495 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:21.155958 25495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f90b7d99f8e64ac9a71f90c8ff6918e4: Generated new TSK 0
I20260811 18:57:21.156330 25495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:21.165341 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25351
2026-08-11T18:57:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2195 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:21 dist-test-slave-68xk krb5kdc[25517](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:21 dist-test-slave-68xk krb5kdc[25517](info): set up 2 sockets
Aug 11 18:57:21 dist-test-slave-68xk krb5kdc[25517](info): commencing operation
krb5kdc: starting...
W20260811 18:57:22.592968 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.383s user 0.003s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:22 dist-test-slave-68xk krb5kdc[25517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:57:22.722047 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:35811
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:36337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:35811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:22.808745 25533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:22.809024 25533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:22.809074 25533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:22.810364 25533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:22.810444 25533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:22.810478 25533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:22.810503 25533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:22.810518 25533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:22.812139 25533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:36337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:35811
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:35811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:22.812345 25533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:22.812525 25533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:22.817438 25540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:22.817440 25546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:22.817454 25541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:22.817736 25533 server_base.cc:1034] running on GCE node
I20260811 18:57:22.817981 25533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:22.818265 25533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:22.819442 25533 hybrid_clock.cc:648] HybridClock initialized: now 1786474642819431 us; error 41 us; skew 500 ppm
Aug 11 18:57:22 dist-test-slave-68xk krb5kdc[25517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474642, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:22.822108 25533 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:57:22.822631 25533 webserver.cc:460] Webserver started at http://127.23.226.254:39643/ using document root <none> and password file <none>
I20260811 18:57:22.822881 25533 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:22.822949 25533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:22.823089 25533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:22.824116 25533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "bfec06186db44a30b3868ea39522d375"
format_stamp: "Formatted at 2026-08-11 18:57:22 on dist-test-slave-68xk"
server_key: "501c53a7f998e8cd1e2b6c848b65ed0f"
server_key_iv: "5c53e03d608ef68be225235a1f705c0a"
server_key_version: "encryptionkey@0"
I20260811 18:57:22.824465 25533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "bfec06186db44a30b3868ea39522d375"
format_stamp: "Formatted at 2026-08-11 18:57:22 on dist-test-slave-68xk"
server_key: "501c53a7f998e8cd1e2b6c848b65ed0f"
server_key_iv: "5c53e03d608ef68be225235a1f705c0a"
server_key_version: "encryptionkey@0"
I20260811 18:57:22.825814 25533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:22.826687 25557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:22.826939 25533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:22.827090 25533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "bfec06186db44a30b3868ea39522d375"
format_stamp: "Formatted at 2026-08-11 18:57:22 on dist-test-slave-68xk"
server_key: "501c53a7f998e8cd1e2b6c848b65ed0f"
server_key_iv: "5c53e03d608ef68be225235a1f705c0a"
server_key_version: "encryptionkey@0"
I20260811 18:57:22.827173 25533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:22.843787 25533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:22.846153 25533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:22.846314 25533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:22.850925 25533 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:35811
I20260811 18:57:22.850970 25636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:35811 every 8 connection(s)
I20260811 18:57:22.851347 25533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:22.852274 25638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:22.854835 25638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375: Bootstrap starting.
I20260811 18:57:22.855413 25638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:22.855680 25638 log.cc:824] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:22.856436 25638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375: No bootstrap required, opened a new log
I20260811 18:57:22.857419 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25533
I20260811 18:57:22.857545 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:22.857733 24459 external_mini_cluster.cc:1428] Setting key 7a36798dd3b2c2e7340146aea14fc725
I20260811 18:57:22.858560 25638 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfec06186db44a30b3868ea39522d375" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35811 } }
I20260811 18:57:22.858733 25638 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:22.858790 25638 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfec06186db44a30b3868ea39522d375, State: Initialized, Role: FOLLOWER
I20260811 18:57:22.858970 25638 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfec06186db44a30b3868ea39522d375" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35811 } }
I20260811 18:57:22.859071 25638 raft_consensus.cc:388] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:22.859110 25638 raft_consensus.cc:482] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:22.859174 25638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:22.860306 25638 raft_consensus.cc:504] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfec06186db44a30b3868ea39522d375" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35811 } }
I20260811 18:57:22.860404 25638 leader_election.cc:302] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bfec06186db44a30b3868ea39522d375; no voters:
I20260811 18:57:22.860744 25638 leader_election.cc:288] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:22.860775 25652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:22.860936 25652 raft_consensus.cc:686] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [term 1 LEADER]: Becoming Leader. State: Replica: bfec06186db44a30b3868ea39522d375, State: Running, Role: LEADER
I20260811 18:57:22.861075 25638 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:22.861083 25652 consensus_queue.cc:237] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfec06186db44a30b3868ea39522d375" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35811 } }
I20260811 18:57:22.861641 25653 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bfec06186db44a30b3868ea39522d375. Latest consensus state: current_term: 1 leader_uuid: "bfec06186db44a30b3868ea39522d375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfec06186db44a30b3868ea39522d375" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35811 } } }
I20260811 18:57:22.861768 25653 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:22.861939 25654 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bfec06186db44a30b3868ea39522d375" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bfec06186db44a30b3868ea39522d375" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 35811 } } }
I20260811 18:57:22.862002 25654 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:22.862393 25669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:22.862989 25669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:22.864612 25669 catalog_manager.cc:1347] Generated new cluster ID: 9a7077ab89824fbf87d91bc0dde3680f
I20260811 18:57:22.864666 25669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:22 dist-test-slave-68xk krb5kdc[25517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:22.869814 25646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.858265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56983 (local address 127.23.226.254:35811)
0811 18:57:22.858474 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.858488 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.858515 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:57:22.858607 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.858612 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.858653 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.858844 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:22.859821 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.860971 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.862049 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.862908 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.863025 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.866010 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:22.866014 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:22.866014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:22.866025 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:22.867975 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.868433 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.868437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.868437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.868571 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.868833 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.868834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.868835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.869136 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:22.869295 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.869488 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.869586 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":111,"threads_started":1}
I20260811 18:57:22.871019 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:22.872532 25669 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:22.873206 25669 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:22.877101 25669 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bfec06186db44a30b3868ea39522d375: Generated new TSK 0
I20260811 18:57:22.877277 25669 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:22.879777 25646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:22.872524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42193 (local address 127.23.226.254:35811)
0811 18:57:22.872559 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:22.872561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:22.872884 (+ 323us) server_negotiation.cc:407] Connection header received
0811 18:57:22.872955 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:22.872956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:22.872965 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:22.873026 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:22.873678 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.874449 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.875445 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:22.875765 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:22.875830 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:22.877159 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:22.877160 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:22.877160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:22.877167 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:22.878687 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.879092 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.879093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.879093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.879141 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:22.879348 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:22.879349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:22.879349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:22.879438 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:22.879524 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:22.879660 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 18:57:22.879723 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 18:57:22.882123 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25533
W20260811 18:57:22.892910 25515 connection.cc:535] client connection to 127.23.226.254:35811 recv error: Network error: failed to read from TLS socket (remote: 127.23.226.254:35811): Connection reset by peer (error 104)
2026-08-11T18:57:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1697 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:22 dist-test-slave-68xk krb5kdc[25694](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:22 dist-test-slave-68xk krb5kdc[25694](info): set up 2 sockets
Aug 11 18:57:22 dist-test-slave-68xk krb5kdc[25694](info): commencing operation
krb5kdc: starting...
W20260811 18:57:24.140817 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:24 dist-test-slave-68xk krb5kdc[25694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:57:24.270125 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:33641
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:38497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:33641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:24.356106 25710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:24.356315 25710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:24.356338 25710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:24.357450 25710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:24.357492 25710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:24.357506 25710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:24.357519 25710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:24.357532 25710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:24.359058 25710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:38497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:33641
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:33641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:24.359319 25710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:24.359543 25710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:24.364464 25718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:24.364495 25721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:24.364477 25719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:24.364867 25710 server_base.cc:1034] running on GCE node
I20260811 18:57:24.365077 25710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:24.365392 25710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:24.366526 25710 hybrid_clock.cc:648] HybridClock initialized: now 1786474644366525 us; error 41 us; skew 500 ppm
Aug 11 18:57:24 dist-test-slave-68xk krb5kdc[25694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474644, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:24.369005 25710 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:57:24.369472 25710 webserver.cc:460] Webserver started at http://127.23.226.254:46705/ using document root <none> and password file <none>
I20260811 18:57:24.369699 25710 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:24.369745 25710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:24.369901 25710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:24.371006 25710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd"
format_stamp: "Formatted at 2026-08-11 18:57:24 on dist-test-slave-68xk"
server_key: "2ea3f42515e0deedbc72197253b38845"
server_key_iv: "ae5bf1ddfcffcbd6f8bc43058c9c03f8"
server_key_version: "encryptionkey@0"
I20260811 18:57:24.371367 25710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd"
format_stamp: "Formatted at 2026-08-11 18:57:24 on dist-test-slave-68xk"
server_key: "2ea3f42515e0deedbc72197253b38845"
server_key_iv: "ae5bf1ddfcffcbd6f8bc43058c9c03f8"
server_key_version: "encryptionkey@0"
I20260811 18:57:24.372696 25710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:24.373471 25730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:24.373677 25710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:24.373768 25710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd"
format_stamp: "Formatted at 2026-08-11 18:57:24 on dist-test-slave-68xk"
server_key: "2ea3f42515e0deedbc72197253b38845"
server_key_iv: "ae5bf1ddfcffcbd6f8bc43058c9c03f8"
server_key_version: "encryptionkey@0"
I20260811 18:57:24.373819 25710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:24.388393 25710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:24.390722 25710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:24.390833 25710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:24.394877 25710 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:33641
I20260811 18:57:24.394956 25809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:33641 every 8 connection(s)
I20260811 18:57:24.395264 25710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:24.396215 25811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:24.398630 25811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd: Bootstrap starting.
I20260811 18:57:24.399220 25811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:24.399526 25811 log.cc:824] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:24.400344 25811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd: No bootstrap required, opened a new log
I20260811 18:57:24.402015 25811 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33641 } }
I20260811 18:57:24.402184 25811 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:24.402233 25811 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae7b3ce0b43d4f93a43eb5a88d281cfd, State: Initialized, Role: FOLLOWER
I20260811 18:57:24.402410 25811 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33641 } }
I20260811 18:57:24.402521 25811 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:24.402565 25811 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:24.402616 25811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:24.403476 25811 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33641 } }
I20260811 18:57:24.403604 25811 leader_election.cc:302] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae7b3ce0b43d4f93a43eb5a88d281cfd; no voters:
I20260811 18:57:24.403782 25811 leader_election.cc:288] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:24.403829 25815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:24.404042 25815 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [term 1 LEADER]: Becoming Leader. State: Replica: ae7b3ce0b43d4f93a43eb5a88d281cfd, State: Running, Role: LEADER
I20260811 18:57:24.404062 25811 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:24.404134 25815 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33641 } }
I20260811 18:57:24.404577 25816 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33641 } } }
I20260811 18:57:24.404680 25816 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:24.404863 25822 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae7b3ce0b43d4f93a43eb5a88d281cfd. Latest consensus state: current_term: 1 leader_uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7b3ce0b43d4f93a43eb5a88d281cfd" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 33641 } } }
I20260811 18:57:24.404930 25822 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:24.404999 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25710
I20260811 18:57:24.405130 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:24.405282 25831 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:24.405356 24459 external_mini_cluster.cc:1428] Setting key 0489de0f3fcaf4c7965833587999a26f
I20260811 18:57:24.405851 25831 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:24.407595 25831 catalog_manager.cc:1347] Generated new cluster ID: c2c97def7ba2433395a92aa294be6ee7
I20260811 18:57:24.407665 25831 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:24.411159 25849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:24.405869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58051 (local address 127.23.226.254:33641)
0811 18:57:24.406268 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:24.406276 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:24.406301 (+ 25us) server_negotiation.cc:407] Connection header received
0811 18:57:24.406606 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:24.406631 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:24.406697 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:24.406845 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:24.407252 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:24.408305 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:24.409123 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:24.409595 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:24.409718 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:24.410494 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:24.410498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:24.410498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:24.410688 (+ 190us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:24.410719 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:24.410730 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:24.410825 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:24.410918 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 18:57:24.410952 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":76,"threads_started":1}
I20260811 18:57:24.412134 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:24.420295 25831 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:24.420995 25831 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:24.422827 25849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:24.414759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46787 (local address 127.23.226.254:33641)
0811 18:57:24.414806 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:24.414808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:24.419862 (+ 5054us) server_negotiation.cc:407] Connection header received
0811 18:57:24.419900 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:24.419901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:24.419914 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:24.419996 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:24.420137 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:24.420748 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:24.421506 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:24.421745 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:24.421824 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:24.422557 (+ 733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:24.422559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:24.422559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:24.422564 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:24.422579 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:24.422583 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:24.422630 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:24.422712 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 18:57:24.422725 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":21}
I20260811 18:57:24.433777 25831 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae7b3ce0b43d4f93a43eb5a88d281cfd: Generated new TSK 0
I20260811 18:57:24.433970 25831 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:24.439102 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25710
W20260811 18:57:24.458287 25691 connection.cc:535] client connection to 127.23.226.254:33641 recv error: Network error: failed to read from TLS socket (remote: 127.23.226.254:33641): Connection reset by peer (error 104)
2026-08-11T18:57:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1565 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:24 dist-test-slave-68xk krb5kdc[25863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:24 dist-test-slave-68xk krb5kdc[25863](info): set up 2 sockets
Aug 11 18:57:24 dist-test-slave-68xk krb5kdc[25863](info): commencing operation
krb5kdc: starting...
W20260811 18:57:25.778929 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:25 dist-test-slave-68xk krb5kdc[25863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:57:25.909593 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:34443
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:41047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:34443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:26.001919 25889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:26.002153 25889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:26.002182 25889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:26.003520 25889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:26.003574 25889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:26.003592 25889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:26.003607 25889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:26.003680 25889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:26.005515 25889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:34443
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:34443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:26.005811 25889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:26.006073 25889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:26.011489 25896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:26.011507 25898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:26.011497 25894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:26.011657 25889 server_base.cc:1034] running on GCE node
I20260811 18:57:26.012015 25889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:26.012390 25889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:26.013590 25889 hybrid_clock.cc:648] HybridClock initialized: now 1786474646013568 us; error 41 us; skew 500 ppm
Aug 11 18:57:26 dist-test-slave-68xk krb5kdc[25863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474646, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:26.016342 25889 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:57:26.016847 25889 webserver.cc:460] Webserver started at http://127.23.226.254:46835/ using document root <none> and password file <none>
I20260811 18:57:26.017076 25889 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:26.017143 25889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:26.017293 25889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:26.018357 25889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "3eec5ee8756749ffb5461eb289208b9d"
format_stamp: "Formatted at 2026-08-11 18:57:26 on dist-test-slave-68xk"
server_key: "c2320be7dad7fc465708f94ff8a8c040"
server_key_iv: "e04b515aff3880e003148869c54b7c44"
server_key_version: "encryptionkey@0"
I20260811 18:57:26.018788 25889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "3eec5ee8756749ffb5461eb289208b9d"
format_stamp: "Formatted at 2026-08-11 18:57:26 on dist-test-slave-68xk"
server_key: "c2320be7dad7fc465708f94ff8a8c040"
server_key_iv: "e04b515aff3880e003148869c54b7c44"
server_key_version: "encryptionkey@0"
I20260811 18:57:26.020223 25889 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:26.020973 25908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:26.021166 25889 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:26.021268 25889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "3eec5ee8756749ffb5461eb289208b9d"
format_stamp: "Formatted at 2026-08-11 18:57:26 on dist-test-slave-68xk"
server_key: "c2320be7dad7fc465708f94ff8a8c040"
server_key_iv: "e04b515aff3880e003148869c54b7c44"
server_key_version: "encryptionkey@0"
I20260811 18:57:26.021350 25889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:26.024741 25889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:26.027046 25889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:26.027230 25889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:26.031769 25889 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:34443
I20260811 18:57:26.031800 25995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:34443 every 8 connection(s)
I20260811 18:57:26.032162 25889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:26.033258 25996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:26.035224 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 25889
I20260811 18:57:26.035363 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:26.035588 24459 external_mini_cluster.cc:1428] Setting key e81821cdf0fdd66c7d22d365d282ea6a
I20260811 18:57:26.036046 25996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d: Bootstrap starting.
I20260811 18:57:26.036712 25996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:26.037012 25996 log.cc:824] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:26.037881 25996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d: No bootstrap required, opened a new log
I20260811 18:57:26.038355 25999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:26.036160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35863 (local address 127.23.226.254:34443)
0811 18:57:26.036364 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:26.036374 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:26.036406 (+ 32us) server_negotiation.cc:407] Connection header received
0811 18:57:26.036942 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:26.036951 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:26.036980 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:26.037200 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:26.037890 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:26.037894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:26.037895 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:26.037900 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:26.037949 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:26.037963 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:26.038058 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:26.038124 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:57:26.038164 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":108,"threads_started":1}
I20260811 18:57:26.039489 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:26.040205 25996 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eec5ee8756749ffb5461eb289208b9d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34443 } }
I20260811 18:57:26.040338 25996 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:26.040361 25996 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eec5ee8756749ffb5461eb289208b9d, State: Initialized, Role: FOLLOWER
I20260811 18:57:26.040486 25996 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eec5ee8756749ffb5461eb289208b9d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34443 } }
I20260811 18:57:26.040606 25996 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:26.040642 25996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:26.040694 25996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:26.041384 25996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eec5ee8756749ffb5461eb289208b9d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34443 } }
I20260811 18:57:26.041503 25996 leader_election.cc:302] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3eec5ee8756749ffb5461eb289208b9d; no voters:
I20260811 18:57:26.041710 25996 leader_election.cc:288] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:26.041767 26010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:26.041960 25996 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:26.042188 26010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [term 1 LEADER]: Becoming Leader. State: Replica: 3eec5ee8756749ffb5461eb289208b9d, State: Running, Role: LEADER
I20260811 18:57:26.042330 26010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eec5ee8756749ffb5461eb289208b9d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34443 } }
I20260811 18:57:26.042537 25999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:26.041003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46519 (local address 127.23.226.254:34443)
0811 18:57:26.041038 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:26.041040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:26.041267 (+ 227us) server_negotiation.cc:407] Connection header received
0811 18:57:26.041347 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:26.041347 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:26.041353 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:26.041415 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:26.042095 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:26.042096 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:26.042096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:26.042102 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:26.042116 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:26.042120 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:26.042179 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:26.042364 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 18:57:26.042378 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:57:26.042757 26011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3eec5ee8756749ffb5461eb289208b9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eec5ee8756749ffb5461eb289208b9d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34443 } } }
I20260811 18:57:26.042837 26011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:26.042976 26011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eec5ee8756749ffb5461eb289208b9d. Latest consensus state: current_term: 1 leader_uuid: "3eec5ee8756749ffb5461eb289208b9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eec5ee8756749ffb5461eb289208b9d" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 34443 } } }
I20260811 18:57:26.043033 26011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:26.043267 26025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:26.043849 26025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:26.045286 26025 catalog_manager.cc:1347] Generated new cluster ID: 839b972b7250405f80bb5d1f95f28b46
I20260811 18:57:26.045338 26025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:26.056489 26025 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:26.056720 26025 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:26.065762 26025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3eec5ee8756749ffb5461eb289208b9d: Generated new TSK 0
I20260811 18:57:26.065974 26025 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:26.077288 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 25889
2026-08-11T18:57:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1630 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:26 dist-test-slave-68xk krb5kdc[26047](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:26 dist-test-slave-68xk krb5kdc[26047](info): set up 2 sockets
Aug 11 18:57:26 dist-test-slave-68xk krb5kdc[26047](info): commencing operation
krb5kdc: starting...
W20260811 18:57:27.342048 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:27 dist-test-slave-68xk krb5kdc[26047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:57:27.470171 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37765
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:35681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:37765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:27.553093 26069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:27.553313 26069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:27.553335 26069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:27.554517 26069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:27.554557 26069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:27.554571 26069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:27.554584 26069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:27.554597 26069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:27.556121 26069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:35681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:37765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:27.556376 26069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:27.556608 26069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:27.561816 26075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:27.561900 26082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:27.561897 26079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:27.562016 26069 server_base.cc:1034] running on GCE node
I20260811 18:57:27.562440 26069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:27.562747 26069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:27.563934 26069 hybrid_clock.cc:648] HybridClock initialized: now 1786474647563898 us; error 49 us; skew 500 ppm
Aug 11 18:57:27 dist-test-slave-68xk krb5kdc[26047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474647, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:27.566488 26069 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:57:27.566951 26069 webserver.cc:460] Webserver started at http://127.23.226.254:45745/ using document root <none> and password file <none>
I20260811 18:57:27.567134 26069 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:27.567175 26069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:27.567265 26069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:27.568243 26069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "10a39f268f50423cbefc0b1cdb2b79d3"
format_stamp: "Formatted at 2026-08-11 18:57:27 on dist-test-slave-68xk"
server_key: "491d655fdbc53d895f1fefaba044d870"
server_key_iv: "5c5ebe68e648534d1c4a466853346a19"
server_key_version: "encryptionkey@0"
I20260811 18:57:27.568553 26069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "10a39f268f50423cbefc0b1cdb2b79d3"
format_stamp: "Formatted at 2026-08-11 18:57:27 on dist-test-slave-68xk"
server_key: "491d655fdbc53d895f1fefaba044d870"
server_key_iv: "5c5ebe68e648534d1c4a466853346a19"
server_key_version: "encryptionkey@0"
I20260811 18:57:27.569830 26069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:27.570550 26094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:27.570703 26069 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 18:57:27.570806 26069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "10a39f268f50423cbefc0b1cdb2b79d3"
format_stamp: "Formatted at 2026-08-11 18:57:27 on dist-test-slave-68xk"
server_key: "491d655fdbc53d895f1fefaba044d870"
server_key_iv: "5c5ebe68e648534d1c4a466853346a19"
server_key_version: "encryptionkey@0"
I20260811 18:57:27.570865 26069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:27.592979 26069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:27.595456 26069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:27.595577 26069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:27.600602 26069 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:37765
I20260811 18:57:27.600666 26181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:37765 every 8 connection(s)
I20260811 18:57:27.601029 26069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:27.602030 26183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:27.604481 26183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3: Bootstrap starting.
I20260811 18:57:27.605114 26183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:27.605456 26183 log.cc:824] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:27.605772 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26069
I20260811 18:57:27.605911 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:27.606139 24459 external_mini_cluster.cc:1428] Setting key 63374f75f1ef17a37535c5818a6ef25a
I20260811 18:57:27.606299 26183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3: No bootstrap required, opened a new log
I20260811 18:57:27.608633 26183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a39f268f50423cbefc0b1cdb2b79d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37765 } }
I20260811 18:57:27.608825 26183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:27.608865 26183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a39f268f50423cbefc0b1cdb2b79d3, State: Initialized, Role: FOLLOWER
I20260811 18:57:27.609014 26183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a39f268f50423cbefc0b1cdb2b79d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37765 } }
I20260811 18:57:27.609104 26183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:27.609136 26183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:27.609181 26183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:27.609906 26183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a39f268f50423cbefc0b1cdb2b79d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37765 } }
I20260811 18:57:27.610018 26183 leader_election.cc:302] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10a39f268f50423cbefc0b1cdb2b79d3; no voters:
I20260811 18:57:27.610172 26183 leader_election.cc:288] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:27.610262 26199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:27.610404 26183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:27.610451 26199 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [term 1 LEADER]: Becoming Leader. State: Replica: 10a39f268f50423cbefc0b1cdb2b79d3, State: Running, Role: LEADER
I20260811 18:57:27.610708 26199 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a39f268f50423cbefc0b1cdb2b79d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37765 } }
I20260811 18:57:27.611161 26200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10a39f268f50423cbefc0b1cdb2b79d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a39f268f50423cbefc0b1cdb2b79d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37765 } } }
I20260811 18:57:27.611167 26201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10a39f268f50423cbefc0b1cdb2b79d3. Latest consensus state: current_term: 1 leader_uuid: "10a39f268f50423cbefc0b1cdb2b79d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a39f268f50423cbefc0b1cdb2b79d3" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37765 } } }
I20260811 18:57:27.611299 26200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:27.611320 26201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3 [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:27.611846 26214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:27.612442 26214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:27.614851 26214 catalog_manager.cc:1347] Generated new cluster ID: d6d71be891c943a882f3f35579376d94
I20260811 18:57:27.614907 26214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 18:57:27 dist-test-slave-68xk krb5kdc[26047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:27.619428 26191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:27.606775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45035 (local address 127.23.226.254:37765)
0811 18:57:27.606968 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:27.606979 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:27.607021 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:57:27.607806 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:27.607816 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:27.607881 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:27.608034 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:27.608659 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:27.610390 (+ 1731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:27.611596 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:27.612437 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:27.612591 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:27.615786 (+ 3195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:27.615791 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:27.615791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:27.615804 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:27.617683 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:27.618120 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:27.618124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:27.618125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:27.618219 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:27.618493 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:27.618494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:27.618495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:27.618773 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:27.618955 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:27.619061 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 18:57:27.619216 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":92,"threads_started":1}
I20260811 18:57:27.620499 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:27.622150 26214 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:27.622828 26214 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:27.626148 26214 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10a39f268f50423cbefc0b1cdb2b79d3: Generated new TSK 0
I20260811 18:57:27.626338 26214 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:27.629422 26191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:27.622035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49817 (local address 127.23.226.254:37765)
0811 18:57:27.622070 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:27.622072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:27.622279 (+ 207us) server_negotiation.cc:407] Connection header received
0811 18:57:27.622342 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:27.622343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:27.622356 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:27.622486 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:27.623129 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:27.623916 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:27.624947 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:27.625308 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:27.625378 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:27.626823 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:27.626824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:27.626824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:27.626831 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:27.628288 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:27.628689 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:27.628690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:27.628690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:27.628743 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:27.628931 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:27.628932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:27.628932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:27.629025 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:27.629148 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:27.629288 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 18:57:27.629362 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 18:57:27.631678 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26069
2026-08-11T18:57:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1554 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:27 dist-test-slave-68xk krb5kdc[26244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:27 dist-test-slave-68xk krb5kdc[26244](info): set up 2 sockets
Aug 11 18:57:27 dist-test-slave-68xk krb5kdc[26244](info): commencing operation
krb5kdc: starting...
W20260811 18:57:28.931559 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:29 dist-test-slave-68xk krb5kdc[26244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:57:29.062288 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42927
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:42927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:29.147627 26262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:29.147883 26262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:29.147926 26262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:29.149101 26262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:29.149183 26262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:29.149211 26262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:29.149245 26262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:29.149272 26262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:29.150828 26262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:42927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:42927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:29.151111 26262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:29.151358 26262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:29.156184 26271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:29.156289 26262 server_base.cc:1034] running on GCE node
W20260811 18:57:29.156287 26269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:29.156168 26275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:29.156656 26262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:29.156991 26262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:29.158136 26262 hybrid_clock.cc:648] HybridClock initialized: now 1786474649158115 us; error 39 us; skew 500 ppm
Aug 11 18:57:29 dist-test-slave-68xk krb5kdc[26244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474649, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:29.160678 26262 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:57:29.161074 26262 webserver.cc:460] Webserver started at http://127.23.226.254:45115/ using document root <none> and password file <none>
I20260811 18:57:29.161289 26262 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:29.161332 26262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:29.161424 26262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:29.162487 26262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "b48a43bb146040bfbbdc32b8ce73e34e"
format_stamp: "Formatted at 2026-08-11 18:57:29 on dist-test-slave-68xk"
server_key: "5e15c7274d1457c5b0fe8a4465f40462"
server_key_iv: "55791bb27ccede1e2e7a232e2e051ba8"
server_key_version: "encryptionkey@0"
I20260811 18:57:29.162817 26262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "b48a43bb146040bfbbdc32b8ce73e34e"
format_stamp: "Formatted at 2026-08-11 18:57:29 on dist-test-slave-68xk"
server_key: "5e15c7274d1457c5b0fe8a4465f40462"
server_key_iv: "55791bb27ccede1e2e7a232e2e051ba8"
server_key_version: "encryptionkey@0"
I20260811 18:57:29.164086 26262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:29.164896 26283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:29.165248 26262 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:29.165364 26262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "b48a43bb146040bfbbdc32b8ce73e34e"
format_stamp: "Formatted at 2026-08-11 18:57:29 on dist-test-slave-68xk"
server_key: "5e15c7274d1457c5b0fe8a4465f40462"
server_key_iv: "55791bb27ccede1e2e7a232e2e051ba8"
server_key_version: "encryptionkey@0"
I20260811 18:57:29.165439 26262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:29.183907 26262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:29.186336 26262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:29.186591 26262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:29.190848 26262 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:42927
I20260811 18:57:29.190891 26370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:42927 every 8 connection(s)
I20260811 18:57:29.191288 26262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:29.192335 26372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:29.194897 26372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e: Bootstrap starting.
I20260811 18:57:29.195518 26372 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:29.195837 26372 log.cc:824] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:29.196714 26372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e: No bootstrap required, opened a new log
I20260811 18:57:29.198424 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26262
I20260811 18:57:29.198540 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:29.198735 24459 external_mini_cluster.cc:1428] Setting key 743fed0d673e7def9ad4a06e4fde2e48
I20260811 18:57:29.198690 26372 raft_consensus.cc:348] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48a43bb146040bfbbdc32b8ce73e34e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42927 } }
I20260811 18:57:29.198880 26372 raft_consensus.cc:374] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:29.198940 26372 raft_consensus.cc:729] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b48a43bb146040bfbbdc32b8ce73e34e, State: Initialized, Role: FOLLOWER
I20260811 18:57:29.199087 26372 consensus_queue.cc:260] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48a43bb146040bfbbdc32b8ce73e34e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42927 } }
I20260811 18:57:29.199177 26372 raft_consensus.cc:388] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:29.199224 26372 raft_consensus.cc:482] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:29.199276 26372 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:29.200521 26372 raft_consensus.cc:504] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48a43bb146040bfbbdc32b8ce73e34e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42927 } }
I20260811 18:57:29.200620 26372 leader_election.cc:302] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b48a43bb146040bfbbdc32b8ce73e34e; no voters:
I20260811 18:57:29.200812 26372 leader_election.cc:288] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:29.200838 26378 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:29.200948 26378 raft_consensus.cc:686] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [term 1 LEADER]: Becoming Leader. State: Replica: b48a43bb146040bfbbdc32b8ce73e34e, State: Running, Role: LEADER
I20260811 18:57:29.201092 26372 sys_catalog.cc:564] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:29.201092 26378 consensus_queue.cc:237] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48a43bb146040bfbbdc32b8ce73e34e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42927 } }
I20260811 18:57:29.201586 26381 sys_catalog.cc:455] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b48a43bb146040bfbbdc32b8ce73e34e. Latest consensus state: current_term: 1 leader_uuid: "b48a43bb146040bfbbdc32b8ce73e34e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48a43bb146040bfbbdc32b8ce73e34e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42927 } } }
I20260811 18:57:29.201732 26381 sys_catalog.cc:458] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:29.201936 26379 sys_catalog.cc:455] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b48a43bb146040bfbbdc32b8ce73e34e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b48a43bb146040bfbbdc32b8ce73e34e" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 42927 } } }
I20260811 18:57:29.202051 26379 sys_catalog.cc:458] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:29.202227 26393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:29.202754 26393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:29.205338 26393 catalog_manager.cc:1347] Generated new cluster ID: 333289995d9f48ef967403b4275ff952
I20260811 18:57:29.205407 26393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:29.205597 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:29.199289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60563 (local address 127.23.226.254:42927)
0811 18:57:29.199521 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:29.199545 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:29.199608 (+ 63us) server_negotiation.cc:407] Connection header received
0811 18:57:29.199729 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:29.199734 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:29.199779 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:29.199893 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:29.200155 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:29.201464 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:29.202692 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:29.203484 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:29.203638 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:29.204445 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:29.204450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:29.204450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:29.204680 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:29.204717 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:29.204730 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:29.204814 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:29.205237 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 18:57:29.205312 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":111,"threads_started":1}
I20260811 18:57:29.206573 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:29.212096 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:29.208246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47395 (local address 127.23.226.254:42927)
0811 18:57:29.208291 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:29.208293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:29.208496 (+ 203us) server_negotiation.cc:407] Connection header received
0811 18:57:29.208559 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:29.208560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:29.208571 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:29.208630 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:29.208772 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:29.209587 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:29.210652 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:29.210969 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:29.211037 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:29.211823 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:29.211824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:29.211825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:29.211831 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:29.211847 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:29.211852 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:29.211909 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:29.211976 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 18:57:29.212003 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:57:29.235924 26393 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:29.236776 26393 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:29.256275 26393 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b48a43bb146040bfbbdc32b8ce73e34e: Generated new TSK 0
I20260811 18:57:29.256531 26393 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:29.263211 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26262
2026-08-11T18:57:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1631 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:29 dist-test-slave-68xk krb5kdc[26421](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:29 dist-test-slave-68xk krb5kdc[26421](info): set up 2 sockets
Aug 11 18:57:29 dist-test-slave-68xk krb5kdc[26421](info): commencing operation
krb5kdc: starting...
W20260811 18:57:30.556804 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:30 dist-test-slave-68xk krb5kdc[26421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:57:30.687502 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37693
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:41499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:37693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:30.772495 26452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:30.772713 26452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:30.772737 26452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:30.773919 26452 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:30.773970 26452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:30.773984 26452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:30.773998 26452 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:30.774010 26452 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:30.775620 26452 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:41499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:37693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:37693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:30.775914 26452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:30.776175 26452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:57:30.781534 26452 server_base.cc:1034] running on GCE node
W20260811 18:57:30.781481 26461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:30.781468 26467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:30.781468 26463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:30.782100 26452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:30.782476 26452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:30.783655 26452 hybrid_clock.cc:648] HybridClock initialized: now 1786474650783624 us; error 56 us; skew 500 ppm
Aug 11 18:57:30 dist-test-slave-68xk krb5kdc[26421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474650, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:30.786671 26452 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:57:30.787181 26452 webserver.cc:460] Webserver started at http://127.23.226.254:39433/ using document root <none> and password file <none>
I20260811 18:57:30.787488 26452 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:30.787582 26452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:30.787758 26452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:30.788978 26452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "6486fbed5c024fa78583de53dac09c1a"
format_stamp: "Formatted at 2026-08-11 18:57:30 on dist-test-slave-68xk"
server_key: "6f412cbfa391508fa232261862c8e2fa"
server_key_iv: "73b47214bb43592e8bf4388273b63819"
server_key_version: "encryptionkey@0"
I20260811 18:57:30.789405 26452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "6486fbed5c024fa78583de53dac09c1a"
format_stamp: "Formatted at 2026-08-11 18:57:30 on dist-test-slave-68xk"
server_key: "6f412cbfa391508fa232261862c8e2fa"
server_key_iv: "73b47214bb43592e8bf4388273b63819"
server_key_version: "encryptionkey@0"
I20260811 18:57:30.791066 26452 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 18:57:30.791971 26477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:30.792201 26452 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:30.792318 26452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "6486fbed5c024fa78583de53dac09c1a"
format_stamp: "Formatted at 2026-08-11 18:57:30 on dist-test-slave-68xk"
server_key: "6f412cbfa391508fa232261862c8e2fa"
server_key_iv: "73b47214bb43592e8bf4388273b63819"
server_key_version: "encryptionkey@0"
I20260811 18:57:30.792398 26452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:30.795944 26452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:30.798337 26452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:30.798547 26452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:30.802662 26452 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:37693
I20260811 18:57:30.802700 26554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:37693 every 8 connection(s)
I20260811 18:57:30.803061 26452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:30.803514 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26452
I20260811 18:57:30.803635 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:30.803912 24459 external_mini_cluster.cc:1428] Setting key 456b069589bb7aa588180c3248e2c8d0
I20260811 18:57:30.804507 26555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:30.808037 26555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a: Bootstrap starting.
I20260811 18:57:30.808607 26555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:30.808876 26555 log.cc:824] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:30.809617 26555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a: No bootstrap required, opened a new log
I20260811 18:57:30.811179 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:30.804491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56463 (local address 127.23.226.254:37693)
0811 18:57:30.809130 (+ 4639us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:30.809139 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:30.809166 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:57:30.809581 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:30.809588 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:30.809612 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:30.809797 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:30.810762 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:30.810766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:30.810766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:30.810772 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:30.810818 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:30.810829 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:30.810934 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:30.810969 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 18:57:30.811009 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4593,"thread_start_us":80,"threads_started":1}
I20260811 18:57:30.812124 26555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6486fbed5c024fa78583de53dac09c1a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37693 } }
I20260811 18:57:30.812291 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:30.812309 26555 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 18:57:30.812364 26555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6486fbed5c024fa78583de53dac09c1a, State: Initialized, Role: FOLLOWER
I20260811 18:57:30.812485 26555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6486fbed5c024fa78583de53dac09c1a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37693 } }
I20260811 18:57:30.812592 26555 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 18:57:30.812638 26555 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 18:57:30.812686 26555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:30.813231 26555 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6486fbed5c024fa78583de53dac09c1a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37693 } }
I20260811 18:57:30.813354 26555 leader_election.cc:302] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6486fbed5c024fa78583de53dac09c1a; no voters:
I20260811 18:57:30.813547 26555 leader_election.cc:288] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 18:57:30.813608 26567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:30.813769 26567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [term 1 LEADER]: Becoming Leader. State: Replica: 6486fbed5c024fa78583de53dac09c1a, State: Running, Role: LEADER
I20260811 18:57:30.813838 26555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:30.813959 26567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6486fbed5c024fa78583de53dac09c1a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37693 } }
I20260811 18:57:30.814392 26569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6486fbed5c024fa78583de53dac09c1a. Latest consensus state: current_term: 1 leader_uuid: "6486fbed5c024fa78583de53dac09c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6486fbed5c024fa78583de53dac09c1a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37693 } } }
I20260811 18:57:30.814527 26569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:30.814389 26568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6486fbed5c024fa78583de53dac09c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6486fbed5c024fa78583de53dac09c1a" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 37693 } } }
I20260811 18:57:30.815058 26568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:30.815239 26584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:30.815239 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:30.813894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50693 (local address 127.23.226.254:37693)
0811 18:57:30.813934 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:30.813936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:30.814005 (+ 69us) server_negotiation.cc:407] Connection header received
0811 18:57:30.814075 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:30.814076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:30.814081 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:30.814129 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:30.814929 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:30.814930 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:30.814931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 18:57:30.814935 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:30.814952 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 18:57:30.814957 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:30.815024 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:30.815157 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 18:57:30.815176 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:57:30.816020 26584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:30.817483 26584 catalog_manager.cc:1347] Generated new cluster ID: 7b90cc8142474384b3c29a4c7cebb058
I20260811 18:57:30.817541 26584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:30.828537 26584 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:30.828758 26584 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:30.833082 26584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6486fbed5c024fa78583de53dac09c1a: Generated new TSK 0
I20260811 18:57:30.833324 26584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:30.837450 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26452
2026-08-11T18:57:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1579 ms)
[----------] 18 tests from AuthTokenIssuingTest (29350 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:30 dist-test-slave-68xk krb5kdc[26606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:30 dist-test-slave-68xk krb5kdc[26606](info): set up 2 sockets
Aug 11 18:57:30 dist-test-slave-68xk krb5kdc[26606](info): commencing operation
krb5kdc: starting...
W20260811 18:57:32.111011 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:57:32.249922 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:36057
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:36057,127.23.226.253:43831,127.23.226.252:40835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:32.340195 26624 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:57:32.340492 26624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:32.340526 26624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:32.340660 26624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:32.342084 26624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:32.342144 26624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:32.342317 26624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:32.342507 26624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:32.342537 26624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:32.344373 26624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:36057,127.23.226.253:43831,127.23.226.252:40835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:36057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:32.344687 26624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:32.344942 26624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:32.350085 26635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:32.350240 26624 server_base.cc:1034] running on GCE node
W20260811 18:57:32.350107 26634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:32.350085 26637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:32.350647 26624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:32.350970 26624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:32.352159 26624 hybrid_clock.cc:648] HybridClock initialized: now 1786474652352141 us; error 46 us; skew 500 ppm
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:32.360594 26624 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:57:32.361150 26624 webserver.cc:460] Webserver started at http://127.23.226.254:40367/ using document root <none> and password file <none>
I20260811 18:57:32.361395 26624 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:32.361465 26624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:32.361632 26624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:32.362876 26624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "60fc27dfd625438496a045389d37029b"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "d13846dde2fa1980ba49a17b35deacf9"
server_key_iv: "c52652f397a7bdd52e1670adbc160457"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.363318 26624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "60fc27dfd625438496a045389d37029b"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "d13846dde2fa1980ba49a17b35deacf9"
server_key_iv: "c52652f397a7bdd52e1670adbc160457"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.364825 26624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:32.365722 26647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:32.366008 26624 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:32.366170 26624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "60fc27dfd625438496a045389d37029b"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "d13846dde2fa1980ba49a17b35deacf9"
server_key_iv: "c52652f397a7bdd52e1670adbc160457"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.366257 26624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:32.379087 26624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:32.381400 26624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:32.381585 26624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:32.386180 26624 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:36057
I20260811 18:57:32.386224 26733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:36057 every 8 connection(s)
I20260811 18:57:32.386687 26624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:32.387624 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:32.389273 26735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:32.396544 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26624
I20260811 18:57:32.396667 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:32.396860 24459 external_mini_cluster.cc:1428] Setting key fb126cf7c8d033aa90638b511ff486d3
I20260811 18:57:32.399416 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.389978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:36057 (local address 127.0.0.1:52082)
0811 18:57:32.390136 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.390172 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.390685 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.390970 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.390973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.391236 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.391399 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.391402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.392430 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.392431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.393103 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.393105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.393570 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.393572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.393634 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.394211 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.394220 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.395733 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.397626 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.397634 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.397637 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.397943 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.398216 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.398217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.398217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.398338 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.398764 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.398770 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.398835 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.398949 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.399235 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":137,"thread_start_us":71,"threads_started":1}
I20260811 18:57:32.399420 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.390139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52082 (local address 127.23.226.254:36057)
0811 18:57:32.390275 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.390280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.390326 (+ 46us) server_negotiation.cc:407] Connection header received
0811 18:57:32.390838 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.390840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.390857 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.390937 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.391487 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.392341 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.393185 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.393491 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.393572 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.395815 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.395822 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.395823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.395829 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.397543 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.398030 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.398033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.398033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.398114 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.398445 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.398447 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.398447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.398686 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.398785 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.398984 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.399167 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
I20260811 18:57:32.400187 26735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:32.400606 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.400465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35856)
0811 18:57:32.400517 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.400570 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 18:57:32.400764 26651 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
I20260811 18:57:32.401244 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.401130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35866)
0811 18:57:32.401180 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.401212 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 18:57:32.401389 26735 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:43831: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.23.226.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab.
Entry for principal kudu/127.23.226.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab.
I20260811 18:57:32.427239 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.253:43831
--webserver_interface=127.23.226.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab
--principal=kudu/127.23.226.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:36057,127.23.226.253:43831,127.23.226.252:40835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:32.450640 26735 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } attempt: 1
I20260811 18:57:32.451181 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.451037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35878)
0811 18:57:32.451106 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.451148 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 18:57:32.451646 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.451541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35884)
0811 18:57:32.451591 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.451627 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 18:57:32.451767 26735 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:43831: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
W20260811 18:57:32.514935 26746 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:57:32.515197 26746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:32.515229 26746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:32.515271 26746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:32.516427 26746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:32.516492 26746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:32.516516 26746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:32.516537 26746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:32.516577 26746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:32.518082 26746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:36057,127.23.226.253:43831,127.23.226.252:40835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab
--principal=kudu/127.23.226.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.253:43831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.226.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:32.518378 26746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:32.518647 26746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:57:32.519929 26735 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } attempt: 2
I20260811 18:57:32.520476 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.520337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35894)
0811 18:57:32.520405 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.520448 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 18:57:32.520833 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.520728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35902)
0811 18:57:32.520778 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.520813 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 18:57:32.520931 26735 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:43831: Network error: Client connection negotiation failed: client connection to 127.23.226.253:43831: connect: Connection refused (error 111)
W20260811 18:57:32.523821 26753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:32.523837 26755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:32.523969 26746 server_base.cc:1034] running on GCE node
W20260811 18:57:32.523926 26752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:32.524434 26746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:32.524751 26746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:32.525924 26746 hybrid_clock.cc:648] HybridClock initialized: now 1786474652525914 us; error 49 us; skew 500 ppm
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:32.528704 26746 init.cc:377] Logged in from keytab as kudu/127.23.226.253@KRBTEST.COM (short username kudu)
I20260811 18:57:32.529168 26746 webserver.cc:460] Webserver started at http://127.23.226.253:41865/ using document root <none> and password file <none>
I20260811 18:57:32.529422 26746 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:32.529492 26746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:32.529644 26746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:32.530798 26746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/data/instance:
uuid: "fc2ef2761c004a4ca3e02c8b18f4f228"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "0ab19e2c1ff15ffba2206d9b73de0b0b"
server_key_iv: "9fe793135d3921a67f43bb393186c0da"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.531172 26746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/wal/instance:
uuid: "fc2ef2761c004a4ca3e02c8b18f4f228"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "0ab19e2c1ff15ffba2206d9b73de0b0b"
server_key_iv: "9fe793135d3921a67f43bb393186c0da"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.532554 26746 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 18:57:32.533439 26765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:32.533651 26746 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:32.533766 26746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/wal
uuid: "fc2ef2761c004a4ca3e02c8b18f4f228"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "0ab19e2c1ff15ffba2206d9b73de0b0b"
server_key_iv: "9fe793135d3921a67f43bb393186c0da"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.533840 26746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:32.549467 26746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:32.551957 26746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:32.552137 26746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:32.556792 26746 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.253:43831
I20260811 18:57:32.556862 26846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.253:43831 every 8 connection(s)
I20260811 18:57:32.557253 26746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
I20260811 18:57:32.558270 26847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:32.559866 26847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:32.563962 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26746
I20260811 18:57:32.564060 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-1/wal/instance
I20260811 18:57:32.564301 24459 external_mini_cluster.cc:1428] Setting key 209bb40635db75d1880a47b159f42121
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:32.571120 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.560649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52088 (local address 127.23.226.254:36057)
0811 18:57:32.560748 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.560751 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.560948 (+ 197us) server_negotiation.cc:407] Connection header received
0811 18:57:32.561583 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.561584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.561601 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.561665 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.562375 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.562995 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.564194 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.564482 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.564573 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.567302 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.567304 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.567304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.567316 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.569301 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.569846 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.569848 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.569849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.569930 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.570281 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.570282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.570283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.570498 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.570585 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.570862 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.570975 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 18:57:32.571144 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.560500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:36057 (local address 127.0.0.1:52088)
0811 18:57:32.560793 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.560849 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.561456 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.561752 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.561770 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.562041 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.562265 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.562269 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.563108 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.563110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.564013 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.564041 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.564580 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.564581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.564731 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.565417 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.565427 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.567174 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.569407 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.569415 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.569417 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.569747 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.570030 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.570031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.570031 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.570207 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.570574 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.570582 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.570710 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.570801 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.570932 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":127,"threads_started":1}
I20260811 18:57:32.571928 26847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.23.226.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.252@KRBTEST.COM" created.
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:57:32.582633 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.572294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35918)
0811 18:57:32.572359 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.572372 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.572420 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.572732 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.572733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.572895 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.572950 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.572951 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.573963 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.573965 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.574583 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.574584 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.575127 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.575128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.575201 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.575736 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.575741 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.579313 (+ 3572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.581322 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.581323 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.581324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.581494 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.581719 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.581720 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.581720 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.581786 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.582157 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.582158 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.582212 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.582290 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.582446 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 18:57:32.582660 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.572379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35918 (local address 127.23.226.253:43831)
0811 18:57:32.572588 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.572592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.572610 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:57:32.572628 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.572629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.572641 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.572732 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.573054 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.573851 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.574700 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.575036 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.575130 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.579426 (+ 4296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.579438 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.579438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.579448 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.581212 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.581580 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.581583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.581584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.581643 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.581888 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.581890 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.581890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.582068 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.582163 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.582340 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.582538 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":179,"thread_start_us":128,"threads_started":1}
I20260811 18:57:32.583523 26847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:32.583948 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.583800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33666)
0811 18:57:32.583861 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.583919 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 18:57:32.584164 26770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
I20260811 18:57:32.584726 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.584587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33678)
0811 18:57:32.584650 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.584686 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 18:57:32.584873 26847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:40835: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab.
Entry for principal kudu/127.23.226.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab.
I20260811 18:57:32.597952 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.252:40835
--webserver_interface=127.23.226.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab
--principal=kudu/127.23.226.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:39351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:36057,127.23.226.253:43831,127.23.226.252:40835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:32.612105 26735 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } attempt: 3
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:57:32.619845 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.612515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35920)
0811 18:57:32.612587 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.612606 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.612651 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.612858 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.612859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.613032 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.613110 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.613112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.613799 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.613800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.614353 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.614355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.614973 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.614974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.615052 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.615610 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.615616 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.616868 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.618701 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.618702 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.618702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.618889 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.619111 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.619112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.619112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.619187 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.619504 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.619505 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.619589 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.619667 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.619763 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 18:57:32.619884 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.612647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35920 (local address 127.23.226.253:43831)
0811 18:57:32.612720 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.612723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.612732 (+ 9us) server_negotiation.cc:407] Connection header received
0811 18:57:32.612767 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.612768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.612779 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.612839 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.613197 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.613709 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.614511 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.614874 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.614966 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.616956 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.616958 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.616959 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.616966 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.618612 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.618971 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.618973 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.618973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.619040 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.619256 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.619257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.619258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.619398 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.619473 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.619709 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.619795 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 18:57:32.620740 26735 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:32.621170 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.621021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33690)
0811 18:57:32.621075 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.621104 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 18:57:32.621608 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.621524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33702)
0811 18:57:32.621565 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.621591 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 18:57:32.621714 26735 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:40835: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
I20260811 18:57:32.634151 26847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } attempt: 1
I20260811 18:57:32.634743 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.634584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33718)
0811 18:57:32.634656 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.634705 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 18:57:32.635207 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.635080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33720)
0811 18:57:32.635151 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.635185 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 18:57:32.635373 26847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:40835: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
I20260811 18:57:32.652877 26735 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } attempt: 1
I20260811 18:57:32.653412 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.653259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33732)
0811 18:57:32.653332 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.653380 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 18:57:32.653793 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.653685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33736)
0811 18:57:32.653736 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.653767 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 18:57:32.653894 26735 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:40835: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
W20260811 18:57:32.688526 26858 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:57:32.688807 26858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:32.688854 26858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:32.688899 26858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:32.690151 26858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:32.690227 26858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:32.690253 26858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:32.690285 26858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:32.690312 26858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:32.691983 26858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:39351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:36057,127.23.226.253:43831,127.23.226.252:40835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab
--principal=kudu/127.23.226.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.252:40835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.226.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:32.692296 26858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:32.692544 26858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:32.697659 26875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:32.697674 26871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:32.697697 26869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:32.698175 26858 server_base.cc:1034] running on GCE node
I20260811 18:57:32.698508 26858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:32.698804 26858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:32.699966 26858 hybrid_clock.cc:648] HybridClock initialized: now 1786474652699941 us; error 41 us; skew 500 ppm
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:32.702821 26858 init.cc:377] Logged in from keytab as kudu/127.23.226.252@KRBTEST.COM (short username kudu)
I20260811 18:57:32.703392 26858 webserver.cc:460] Webserver started at http://127.23.226.252:40265/ using document root <none> and password file <none>
I20260811 18:57:32.703704 26858 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:32.703766 26858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:32.703644 26847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } attempt: 2
I20260811 18:57:32.703907 26858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:32.704169 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.704020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33750)
0811 18:57:32.704082 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.704133 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 18:57:32.704571 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.704457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33762)
0811 18:57:32.704512 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.704544 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 18:57:32.704679 26847 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:40835: Network error: Client connection negotiation failed: client connection to 127.23.226.252:40835: connect: Connection refused (error 111)
I20260811 18:57:32.705288 26858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/data/instance:
uuid: "5ebbbe78c4404b8c967d789d8eaea803"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "505fd92c12e8e128f97c0bf8053f2672"
server_key_iv: "8f0c0f815cc2ff0c61920ce7157d5d67"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.705632 26858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/wal/instance:
uuid: "5ebbbe78c4404b8c967d789d8eaea803"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "505fd92c12e8e128f97c0bf8053f2672"
server_key_iv: "8f0c0f815cc2ff0c61920ce7157d5d67"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.707106 26858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:32.707904 26889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:32.708139 26858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:32.708241 26858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/wal
uuid: "5ebbbe78c4404b8c967d789d8eaea803"
format_stamp: "Formatted at 2026-08-11 18:57:32 on dist-test-slave-68xk"
server_key: "505fd92c12e8e128f97c0bf8053f2672"
server_key_iv: "8f0c0f815cc2ff0c61920ce7157d5d67"
server_key_version: "encryptionkey@0"
I20260811 18:57:32.708302 26858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:32.717730 26858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:32.720165 26858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:32.720281 26858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:32.724506 26858 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.252:40835
I20260811 18:57:32.724562 26962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.252:40835 every 8 connection(s)
I20260811 18:57:32.724915 26858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
I20260811 18:57:32.725894 26963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:32.727679 26963 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:32.729033 26735 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } attempt: 2
I20260811 18:57:32.734089 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 26858
I20260811 18:57:32.734200 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786474364687722-24459-0/minicluster-data/master-2/wal/instance
I20260811 18:57:32.734402 24459 external_mini_cluster.cc:1428] Setting key 7a75f30638c2cb02d35621d22f150c58
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:32.739188 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.729301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33770)
0811 18:57:32.729355 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.729366 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.729411 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.729735 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.729736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.729913 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.729963 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.729964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.731086 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.731087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.731893 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.731895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.732430 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.732432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.732488 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.733023 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.733028 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.735015 (+ 1987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.737568 (+ 2553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.737569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.737570 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.737859 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.738158 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.738159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.738159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.738225 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.738736 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.738737 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.738792 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.738953 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.739059 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 18:57:32.739389 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.728496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52090 (local address 127.23.226.254:36057)
0811 18:57:32.728604 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.728606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.728802 (+ 196us) server_negotiation.cc:407] Connection header received
0811 18:57:32.729494 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.729496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.729509 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.729556 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.730334 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.730850 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.732132 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.732316 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.732398 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.736224 (+ 3826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.736226 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.736226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.736235 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.738006 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.738488 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.738489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.738490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.738548 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.738757 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.738759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.738759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.738895 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.738958 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.739219 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.739307 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 18:57:32.739593 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.728396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:36057 (local address 127.0.0.1:52090)
0811 18:57:32.728674 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.728713 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.729316 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.729625 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.729629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.730039 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.730243 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.730248 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.730932 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.730933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.732018 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.732020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.732406 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.732407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.732484 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.733171 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.733181 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.736096 (+ 2915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.738106 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.738113 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.738116 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.738388 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.738603 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.738603 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.738604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.738677 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.738989 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.738996 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.739064 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.739164 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.739327 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":101,"threads_started":1}
I20260811 18:57:32.740346 26963 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:32.740464 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.729409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33770 (local address 127.23.226.252:40835)
0811 18:57:32.729584 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.729588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.729603 (+ 15us) server_negotiation.cc:407] Connection header received
0811 18:57:32.729629 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.729630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.729645 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.729715 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.730051 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.731010 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.731991 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.732321 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.732474 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.735124 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.735134 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.735135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.735142 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.737470 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.737931 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.737934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.737934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.738040 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.738297 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.738297 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.738298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.738657 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.738746 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.740239 (+ 1493us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.740345 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:57:32.742599 26735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b: Bootstrap starting.
I20260811 18:57:32.743772 26735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:32.744146 26735 log.cc:824] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:57:32.745023 26735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b: No bootstrap required, opened a new log
I20260811 18:57:32.745589 26974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.735159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33780 (local address 127.23.226.252:40835)
0811 18:57:32.735315 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.735317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.735325 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:32.735346 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.735347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.735357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.735437 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.736256 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.736933 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.738091 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.738404 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.738536 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.741483 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.741485 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.741485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.741492 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.744096 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.744556 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.744558 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.744558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.744616 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.744852 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.744853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.744854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.744995 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.745171 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.745369 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.745450 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":81,"threads_started":1}
I20260811 18:57:32.747311 26735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } }
I20260811 18:57:32.747467 26735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fc27dfd625438496a045389d37029b, State: Initialized, Role: FOLLOWER
I20260811 18:57:32.747548 26735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } }
I20260811 18:57:32.747885 26735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:32.747850 26977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.748085 26977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:32.748409 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.740645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:43831 (local address 127.0.0.1:35928)
0811 18:57:32.740843 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.740853 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.740894 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.741114 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.741115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.741293 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.741334 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.741336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.742173 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.742174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.742836 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.742838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.743359 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.743360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.743414 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.743775 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.743780 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.745355 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.747313 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.747314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.747314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.747528 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.747745 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.747746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.747746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.747813 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.748119 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.748120 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.748167 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.748236 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.748326 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184}
I20260811 18:57:32.748726 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.740725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35928 (local address 127.23.226.253:43831)
0811 18:57:32.740892 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.740894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.740904 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:57:32.740985 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.740986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.740998 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.741059 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.741435 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.742068 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.742920 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.743234 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.743302 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.745446 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.745448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.745449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.745456 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.747213 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.747606 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.747608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.747608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.747676 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.747887 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.747888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.747888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.748026 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.748088 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.748538 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.748623 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260811 18:57:32.749361 26963 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } has no permanent_uuid. Determining permanent_uuid...
W20260811 18:57:32.750149 26995 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:32.750252 26995 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:57:32.750866 26624 master_runner.cc:186] Error getting master registration for 127.23.226.253:43831: OK, instance_id { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" instance_seqno: 1786474652555561 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:57:32.754074 26624 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:57:32.755734 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.746311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52092 (local address 127.23.226.254:36057)
0811 18:57:32.746359 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.746361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.746596 (+ 235us) server_negotiation.cc:407] Connection header received
0811 18:57:32.746659 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.746659 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.746669 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.746732 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.747320 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.747982 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.749162 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.749554 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.750388 (+ 834us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.752814 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.752816 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.752816 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.752823 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.754501 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.754897 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.754898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.754898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.754959 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.755194 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.755196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.755196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.755321 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.755498 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.755547 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.755618 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:57:32.757077 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.749609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33792)
0811 18:57:32.749658 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.749670 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.749709 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.749859 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.749860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.750003 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.750036 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.750038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.750916 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.750917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.751626 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.751628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.752206 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.752207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.752256 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.752656 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.752661 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.754020 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.755972 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.755973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.755973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.756172 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.756383 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.756384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.756384 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.756443 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.756744 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.756745 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.756790 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.756867 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.756957 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 18:57:32.757324 26974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.749686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33792 (local address 127.23.226.252:40835)
0811 18:57:32.749747 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.749750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.749756 (+ 6us) server_negotiation.cc:407] Connection header received
0811 18:57:32.749774 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.749774 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.749784 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.749837 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.750121 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.750837 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.751727 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.752082 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.752144 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.754110 (+ 1966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.754111 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.754111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.754117 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.755886 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.756245 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.756245 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.756246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.756314 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.756512 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.756513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.756513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.756656 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.756732 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.756915 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.757021 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":40}
I20260811 18:57:32.758970 26963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803: Bootstrap starting.
I20260811 18:57:32.759742 26963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:32.760042 26963 log.cc:824] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:57:32.760914 26963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803: No bootstrap required, opened a new log
I20260811 18:57:32.763230 26963 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } }
I20260811 18:57:32.763391 26963 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ebbbe78c4404b8c967d789d8eaea803, State: Initialized, Role: FOLLOWER
I20260811 18:57:32.763527 26963 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } }
I20260811 18:57:32.763841 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.756330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35934 (local address 127.23.226.253:43831)
0811 18:57:32.756367 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.756369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.756377 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:32.756434 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.756435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.756444 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.756502 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.757131 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.757764 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.758477 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.758693 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.758771 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.761163 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.761165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.761165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.761173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.762705 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.763065 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.763066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.763066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.763126 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.763333 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.763334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.763335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.763460 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.763615 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.763653 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.763735 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:32.763880 26963 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:32.764532 26998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.764719 26998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:32.765365 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:32.766453 26691 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "60fc27dfd625438496a045389d37029b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52092
I20260811 18:57:32.766577 26691 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 18:57:32.766618 26691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:32.767788 26691 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } }
I20260811 18:57:32.768040 26691 leader_election.cc:288] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [CANDIDATE]: Term 1 election: Requested vote from peers fc2ef2761c004a4ca3e02c8b18f4f228 (127.23.226.253:43831), 5ebbbe78c4404b8c967d789d8eaea803 (127.23.226.252:40835)
W20260811 18:57:32.768029 27018 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:32.768078 27018 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:57:32.769268 26930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "60fc27dfd625438496a045389d37029b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5ebbbe78c4404b8c967d789d8eaea803"
I20260811 18:57:32.769394 26930 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:32.767745 26858 master_runner.cc:186] Error getting master registration for 127.23.226.253:43831: OK, instance_id { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" instance_seqno: 1786474652555561 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:57:32.769977 26858 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:57:32.770447 26930 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fc27dfd625438496a045389d37029b in term 1.
I20260811 18:57:32.770664 26656 leader_election.cc:302] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ebbbe78c4404b8c967d789d8eaea803, 60fc27dfd625438496a045389d37029b; no voters:
I20260811 18:57:32.770818 26977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:32.770996 26977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [term 1 LEADER]: Becoming Leader. State: Replica: 60fc27dfd625438496a045389d37029b, State: Running, Role: LEADER
I20260811 18:57:32.771099 26977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } }
I20260811 18:57:32.771723 27031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60fc27dfd625438496a045389d37029b. Latest consensus state: current_term: 1 leader_uuid: "60fc27dfd625438496a045389d37029b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.771930 27031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:32.772276 27034 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 18:57:32.772493 27034 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 18:57:32.774268 26930 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [term 1 FOLLOWER]: Refusing update from remote peer 60fc27dfd625438496a045389d37029b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:32.774652 27031 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:32.776072 26998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60fc27dfd625438496a045389d37029b. Latest consensus state: current_term: 1 leader_uuid: "60fc27dfd625438496a045389d37029b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.776194 26998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:32.783039 26974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.769436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33804 (local address 127.23.226.252:40835)
0811 18:57:32.769475 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.769477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.774732 (+ 5255us) server_negotiation.cc:407] Connection header received
0811 18:57:32.774933 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.774934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.774944 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.774973 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.775772 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.776496 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.777672 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.777988 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.778029 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.779673 (+ 1644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.779674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.779675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.779682 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.781373 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.782135 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.782136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.782136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.782197 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.782398 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.782399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.782399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.782551 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.782651 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.782867 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.782944 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:32.785337 27031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "60fc27dfd625438496a045389d37029b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.785435 27031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:32.785813 27036 mvcc.cc:205] Tried to move back new op lower bound from 7317400177760636928 to 7317400177751224320. Current Snapshot: MvccSnapshot[applied={T|T < 7317400177760636928}]
I20260811 18:57:32.786006 26998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "60fc27dfd625438496a045389d37029b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.786103 26998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:32.786311 27041 mvcc.cc:205] Tried to move back new op lower bound from 7317400177760636928 to 7317400177751224320. Current Snapshot: MvccSnapshot[applied={T|T < 7317400177760636928}]
I20260811 18:57:32.787878 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.774809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52108 (local address 127.23.226.254:36057)
0811 18:57:32.774848 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.774849 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.776292 (+ 1443us) server_negotiation.cc:407] Connection header received
0811 18:57:32.776455 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.776456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.776466 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.776497 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.777954 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.778688 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.780690 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.781001 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.781069 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.783728 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.783730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.783731 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.783739 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.785685 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.786672 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.786674 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.786674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.786735 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.787075 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.787076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.787076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.787217 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.787308 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.787703 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.787790 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:32.790007 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.775064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35944 (local address 127.23.226.253:43831)
0811 18:57:32.776085 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.776087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.781011 (+ 4924us) server_negotiation.cc:407] Connection header received
0811 18:57:32.781117 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.781119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.781130 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.781161 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.782841 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.783575 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.784738 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.785078 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.785149 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.786902 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.786903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.786903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.786911 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.788547 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.789162 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.789164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.789164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.789230 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.789448 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.789448 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.789449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.789576 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.789669 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.789831 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.789913 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":994}
I20260811 18:57:32.794781 27034 catalog_manager.cc:1347] Generated new cluster ID: 5327b3f3ef3a4d8cbe542edbaed0ca8d
I20260811 18:57:32.794839 27034 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:32.795854 26847 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } attempt: 3
Aug 11 18:57:32 dist-test-slave-68xk krb5kdc[26606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474652, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:57:32.805104 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.796310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:40835 (local address 127.0.0.1:33814)
0811 18:57:32.796605 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:32.796616 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:32.796656 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:32.797194 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:32.797195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:32.797365 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:32.797409 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.797410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.798329 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.798330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.799152 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:32.799155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.799821 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.799822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:32.799894 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.800344 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:32.800349 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:32.801876 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:32.803857 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.803858 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.803858 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.804084 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.804354 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:32.804355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:32.804356 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:32.804430 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:32.804755 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:32.804756 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:32.804815 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 18:57:32.804889 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 18:57:32.804985 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279}
I20260811 18:57:32.805557 26974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.796832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33814 (local address 127.23.226.252:40835)
0811 18:57:32.796867 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.796869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.796876 (+ 7us) server_negotiation.cc:407] Connection header received
0811 18:57:32.796893 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.796894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.796903 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.796949 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.797492 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.798235 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.799273 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.799592 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.799648 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.802016 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:32.802018 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:32.802018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:32.802026 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:32.803741 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.804196 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.804197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.804198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.804270 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:32.804509 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:32.804510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:32.804510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:32.804648 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:32.804709 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.805380 (+ 671us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.805468 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 18:57:32.807267 26847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228: Bootstrap starting.
I20260811 18:57:32.808060 26847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:32.808413 26847 log.cc:824] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:32.816318 26847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228: No bootstrap required, opened a new log
I20260811 18:57:32.818666 27034 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:32.819247 26847 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } }
I20260811 18:57:32.819399 26847 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2ef2761c004a4ca3e02c8b18f4f228, State: Initialized, Role: FOLLOWER
I20260811 18:57:32.819423 27034 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:32.819490 26847 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } }
I20260811 18:57:32.819904 27047 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.819897 26807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "60fc27dfd625438496a045389d37029b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228"
I20260811 18:57:32.820261 27047 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:32.819877 26847 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:32.819981 26806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:32.821092 26806 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [term 1 FOLLOWER]: Refusing update from remote peer 60fc27dfd625438496a045389d37029b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:32.821444 27031 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:32.823199 27047 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60fc27dfd625438496a045389d37029b. Latest consensus state: current_term: 1 leader_uuid: "60fc27dfd625438496a045389d37029b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.823354 27047 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:32.823446 27047 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "60fc27dfd625438496a045389d37029b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.823554 27047 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:32.824417 27034 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b: Generated new TSK 0
I20260811 18:57:32.824627 27034 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 18:57:32.824862 26807 raft_consensus.cc:2396] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60fc27dfd625438496a045389d37029b for term 1 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 18:57:32.825572 26977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "60fc27dfd625438496a045389d37029b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fc27dfd625438496a045389d37029b" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 36057 } } peers { permanent_uuid: "fc2ef2761c004a4ca3e02c8b18f4f228" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 43831 } } peers { permanent_uuid: "5ebbbe78c4404b8c967d789d8eaea803" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 40835 } } }
I20260811 18:57:32.825680 26977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60fc27dfd625438496a045389d37029b [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:32.825908 27048 mvcc.cc:205] Tried to move back new op lower bound from 7317400177937825792 to 7317400177751224320. Current Snapshot: MvccSnapshot[applied={T|T < 7317400177760636928}]
I20260811 18:57:32.827515 27067 catalog_manager.cc:1259] Loaded cluster ID: 5327b3f3ef3a4d8cbe542edbaed0ca8d
I20260811 18:57:32.827565 27067 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228: loading cluster ID for follower catalog manager: success
I20260811 18:57:32.828678 27067 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228: acquiring CA information for follower catalog manager: success
I20260811 18:57:32.829018 27067 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fc2ef2761c004a4ca3e02c8b18f4f228: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 18:57:32.852551 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.850722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33818 (local address 127.23.226.252:40835)
0811 18:57:32.850773 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.850788 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.851797 (+ 1009us) server_negotiation.cc:407] Connection header received
0811 18:57:32.851919 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.851920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.851934 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.851966 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.852473 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33818: BlockingRecv error: recv got EOF from 127.0.0.1:33818 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 18:57:32.853403 26739 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.851164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52120 (local address 127.23.226.254:36057)
0811 18:57:32.851208 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.851210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.852833 (+ 1623us) server_negotiation.cc:407] Connection header received
0811 18:57:32.852934 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.852935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.852945 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.852974 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.853344 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52120: BlockingRecv error: recv got EOF from 127.0.0.1:52120 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 18:57:32.854337 26852 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.851490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35950 (local address 127.23.226.253:43831)
0811 18:57:32.851529 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.851531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.853627 (+ 2096us) server_negotiation.cc:407] Connection header received
0811 18:57:32.853825 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.853827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.853840 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.853873 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.854270 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35950: BlockingRecv error: recv got EOF from 127.0.0.1:35950 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:32.859865 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.856156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35960 (local address 127.23.226.253:43831)
0811 18:57:32.856196 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.856197 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.856467 (+ 270us) server_negotiation.cc:407] Connection header received
0811 18:57:32.856584 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.856585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.856633 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.856680 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:32.856934 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.857689 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.858873 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.859153 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.859197 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.859450 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:32.859585 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:32.859637 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.859754 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.859788 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 18:57:32.863507 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.862614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33826 (local address 127.23.226.252:40835)
0811 18:57:32.862659 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.862661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.862911 (+ 250us) server_negotiation.cc:407] Connection header received
0811 18:57:32.863025 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.863026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.863048 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.863078 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.863453 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33826: BlockingRecv error: recv got EOF from 127.0.0.1:33826 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:57:32.869527 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.865973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35966 (local address 127.23.226.253:43831)
0811 18:57:32.866014 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.866015 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.866287 (+ 272us) server_negotiation.cc:407] Connection header received
0811 18:57:32.866394 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.866395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.866510 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.866547 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:32.866751 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.867442 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.868556 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.868866 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.868916 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.869166 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:32.869204 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:32.869234 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.869427 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.869453 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 18:57:32.873131 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.872206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33828 (local address 127.23.226.252:40835)
0811 18:57:32.872248 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.872250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.872527 (+ 277us) server_negotiation.cc:407] Connection header received
0811 18:57:32.872631 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.872633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.872646 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.872677 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.873075 (+ 398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33828: BlockingRecv error: recv got EOF from 127.0.0.1:33828 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:57:32.879889 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.876455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35974 (local address 127.23.226.253:43831)
0811 18:57:32.876496 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.876498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.876795 (+ 297us) server_negotiation.cc:407] Connection header received
0811 18:57:32.876907 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.876908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.876920 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.876950 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:32.877136 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.877866 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.879026 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.879292 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.879359 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.879588 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:32.879626 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:32.879656 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.879770 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.879809 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 18:57:32.883790 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.882806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33830 (local address 127.23.226.252:40835)
0811 18:57:32.882855 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.882857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.883158 (+ 301us) server_negotiation.cc:407] Connection header received
0811 18:57:32.883266 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.883267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.883280 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.883314 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.883716 (+ 402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33830: BlockingRecv error: recv got EOF from 127.0.0.1:33830 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:57:32.892591 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.889059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35984 (local address 127.23.226.253:43831)
0811 18:57:32.889103 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.889105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.889394 (+ 289us) server_negotiation.cc:407] Connection header received
0811 18:57:32.889504 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.889505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.889517 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.889547 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:32.889749 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.890586 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.891732 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.892027 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.892077 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.892308 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:32.892345 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:32.892374 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.892486 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.892507 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 18:57:32.896168 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.895226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.23.226.252:40835)
0811 18:57:32.895270 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.895272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.895551 (+ 279us) server_negotiation.cc:407] Connection header received
0811 18:57:32.895657 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.895658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.895670 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.895701 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.896108 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33838: BlockingRecv error: recv got EOF from 127.0.0.1:33838 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:57:32.909165 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.905517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35998 (local address 127.23.226.253:43831)
0811 18:57:32.905567 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.905570 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.905886 (+ 316us) server_negotiation.cc:407] Connection header received
0811 18:57:32.905993 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.905995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.906006 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.906039 (+ 33us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:32.906223 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.907074 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.908287 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.908606 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.908651 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.908879 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:32.908916 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:32.908944 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.909051 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.909072 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 18:57:32.912842 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.911834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33842 (local address 127.23.226.252:40835)
0811 18:57:32.911888 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.911890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.912185 (+ 295us) server_negotiation.cc:407] Connection header received
0811 18:57:32.912283 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.912284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.912295 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.912327 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.912762 (+ 435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33842: BlockingRecv error: recv got EOF from 127.0.0.1:33842 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 18:57:32.933516 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.930197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36000 (local address 127.23.226.253:43831)
0811 18:57:32.930244 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.930246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.930570 (+ 324us) server_negotiation.cc:407] Connection header received
0811 18:57:32.930673 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.930674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.930685 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.930714 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:32.930904 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.931623 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.932733 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.933032 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.933071 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.933257 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:32.933291 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:32.933317 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.933412 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.933431 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 18:57:32.936990 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.935990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33848 (local address 127.23.226.252:40835)
0811 18:57:32.936034 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.936036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.936291 (+ 255us) server_negotiation.cc:407] Connection header received
0811 18:57:32.936429 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.936430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.936457 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.936488 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.936934 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33848: BlockingRecv error: recv got EOF from 127.0.0.1:33848 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:57:32.972992 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:32.970349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36016 (local address 127.23.226.253:43831)
0811 18:57:32.970403 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.970422 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.970586 (+ 164us) server_negotiation.cc:407] Connection header received
0811 18:57:32.970659 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.970660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.970673 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.970732 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:32.970881 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.971447 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.972231 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:32.972447 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:32.972527 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:32.972675 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:32.972721 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:32.972788 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:32.972870 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 18:57:32.972890 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 18:57:32.975548 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:32.974796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33862 (local address 127.23.226.252:40835)
0811 18:57:32.974843 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:32.974845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:32.975035 (+ 190us) server_negotiation.cc:407] Connection header received
0811 18:57:32.975102 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:32.975103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:32.975115 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:32.975171 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:32.975494 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33862: BlockingRecv error: recv got EOF from 127.0.0.1:33862 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:57:33.043746 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.040837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36026 (local address 127.23.226.253:43831)
0811 18:57:33.040951 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.040953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.041151 (+ 198us) server_negotiation.cc:407] Connection header received
0811 18:57:33.041194 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.041195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.041207 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.041278 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:33.041437 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.041986 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.042930 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.043163 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.043247 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:33.043421 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:33.043464 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:33.043534 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:33.043615 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 18:57:33.043637 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 18:57:33.046494 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:33.045831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33864 (local address 127.23.226.252:40835)
0811 18:57:33.045882 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.045884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.045913 (+ 29us) server_negotiation.cc:407] Connection header received
0811 18:57:33.045986 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.045987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.045997 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.046051 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:33.046411 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33864: BlockingRecv error: recv got EOF from 127.0.0.1:33864 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 18:57:33.178746 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.175795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36042 (local address 127.23.226.253:43831)
0811 18:57:33.175906 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.175908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.176009 (+ 101us) server_negotiation.cc:407] Connection header received
0811 18:57:33.176181 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.176182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.176203 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.176273 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:33.176439 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.176986 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.177920 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.178160 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.178249 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:33.178455 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:33.178486 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:33.178553 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:33.178619 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 18:57:33.178641 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 18:57:33.181416 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:33.180649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33880 (local address 127.23.226.252:40835)
0811 18:57:33.180748 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.180750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.180827 (+ 77us) server_negotiation.cc:407] Connection header received
0811 18:57:33.180899 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.180900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.180911 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.180979 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:33.181374 (+ 395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33880: BlockingRecv error: recv got EOF from 127.0.0.1:33880 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 18:57:33.441469 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.439037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36046 (local address 127.23.226.253:43831)
0811 18:57:33.439135 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.439143 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.439185 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:57:33.439212 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.439213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.439227 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.439279 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:33.439497 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.439987 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.440832 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.441016 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.441069 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:33.441242 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:33.441270 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:33.441308 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:33.441390 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 18:57:33.441407 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 18:57:33.444222 26974 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:33.443549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33886 (local address 127.23.226.252:40835)
0811 18:57:33.443616 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.443619 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.443629 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:57:33.443706 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.443707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.443720 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.443784 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:33.444157 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33886: BlockingRecv error: recv got EOF from 127.0.0.1:33886 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 18:57:33.768559 27018 catalog_manager.cc:1259] Loaded cluster ID: 5327b3f3ef3a4d8cbe542edbaed0ca8d
I20260811 18:57:33.768637 27018 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803: loading cluster ID for follower catalog manager: success
I20260811 18:57:33.769510 27018 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803: acquiring CA information for follower catalog manager: success
I20260811 18:57:33.769861 27018 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5ebbbe78c4404b8c967d789d8eaea803: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:57:33.960685 27258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.957644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36060 (local address 127.23.226.253:43831)
0811 18:57:33.957828 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.957831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.957935 (+ 104us) server_negotiation.cc:407] Connection header received
0811 18:57:33.958049 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.958050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.958074 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.958196 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:33.958360 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.958966 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.959849 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.960079 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.960181 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:33.960362 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:33.960404 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:33.960473 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:33.960545 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 18:57:33.960569 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
I20260811 18:57:33.965576 27267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.962675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33894 (local address 127.23.226.252:40835)
0811 18:57:33.962807 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.962809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.962820 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:57:33.962854 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.962855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.962925 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.963023 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:33.963136 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.963740 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.964657 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.964893 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.964978 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:33.965170 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:33.965297 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:33.965396 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:33.965442 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 18:57:33.965467 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":65,"threads_started":1}
I20260811 18:57:33.970605 27258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.967717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36068 (local address 127.23.226.253:43831)
0811 18:57:33.967772 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.967774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.967883 (+ 109us) server_negotiation.cc:407] Connection header received
0811 18:57:33.967990 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.967991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.968007 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.968040 (+ 33us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:33.968258 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.968969 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.969844 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.970062 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.970166 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:33.970314 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:33.970349 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:33.970402 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:33.970492 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 18:57:33.970513 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 18:57:33.971134 27267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.967477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33900 (local address 127.23.226.252:40835)
0811 18:57:33.967607 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.967609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.967811 (+ 202us) server_negotiation.cc:407] Connection header received
0811 18:57:33.967886 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.967887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.967897 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.967943 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:33.968122 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.968856 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.970184 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.970523 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.970566 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:33.970815 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:33.970849 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:33.970880 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:33.971012 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 18:57:33.971041 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 18:57:33.971376 27278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:33.967492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52122 (local address 127.23.226.254:36057)
0811 18:57:33.967632 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:33.967635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:33.967646 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:57:33.967739 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:33.967740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:33.967798 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:33.967888 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:33.968045 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.968870 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.970220 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:33.970582 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:33.970643 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:33.970878 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:33.971010 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:33.971077 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:33.971245 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 18:57:33.971282 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260811 18:57:33.973542 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26624
I20260811 18:57:33.985836 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26746
I20260811 18:57:33.995436 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 26858
2026-08-11T18:57:34Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3164 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 18:57:34 dist-test-slave-68xk krb5kdc[27288](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 18:57:34 dist-test-slave-68xk krb5kdc[27288](info): set up 2 sockets
Aug 11 18:57:34 dist-test-slave-68xk krb5kdc[27288](info): commencing operation
krb5kdc: starting...
W20260811 18:57:35.275913 24459 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/test-user.keytab.
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T18:57:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T18:57:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.23.226.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
Entry for principal kudu/127.23.226.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab.
I20260811 18:57:35.410024 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46727
--webserver_interface=127.23.226.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:46727,127.23.226.253:33455,127.23.226.252:36655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 18:57:35.496662 27315 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:57:35.496945 27315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:35.496984 27315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:35.497015 27315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:35.498186 27315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:35.498256 27315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:35.498279 27315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:35.498308 27315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:35.498327 27315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:35.499953 27315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:46727,127.23.226.253:33455,127.23.226.252:36655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.254.keytab
--principal=kudu/127.23.226.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.254:46727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.23.226.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:35.500252 27315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:35.500485 27315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:35.506291 27326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:35.506295 27325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:35.506614 27315 server_base.cc:1034] running on GCE node
W20260811 18:57:35.507236 27329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:35.507635 27315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:35.508035 27315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:35.509227 27315 hybrid_clock.cc:648] HybridClock initialized: now 1786474655509204 us; error 42 us; skew 500 ppm
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:35.513254 27315 init.cc:377] Logged in from keytab as kudu/127.23.226.254@KRBTEST.COM (short username kudu)
I20260811 18:57:35.513899 27315 webserver.cc:460] Webserver started at http://127.23.226.254:44011/ using document root <none> and password file <none>
I20260811 18:57:35.514185 27315 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:35.514266 27315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:35.514448 27315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:35.516000 27315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/data/instance:
uuid: "f3495beecc70458795e5da63935217cb"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "68d210a4b33f8f61535895a4034a6ce5"
server_key_iv: "3e36eeb1c1bb5fce041e45f941c6d299"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.516469 27315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/wal/instance:
uuid: "f3495beecc70458795e5da63935217cb"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "68d210a4b33f8f61535895a4034a6ce5"
server_key_iv: "3e36eeb1c1bb5fce041e45f941c6d299"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.518461 27315 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 18:57:35.519480 27339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:35.519721 27315 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:35.519843 27315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/wal
uuid: "f3495beecc70458795e5da63935217cb"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "68d210a4b33f8f61535895a4034a6ce5"
server_key_iv: "3e36eeb1c1bb5fce041e45f941c6d299"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.519940 27315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:35.539887 27315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:35.542826 27315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:35.542999 27315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:35.548766 27315 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.254:46727
I20260811 18:57:35.548808 27429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.254:46727 every 8 connection(s)
I20260811 18:57:35.549296 27315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/data/info.pb
I20260811 18:57:35.550458 27433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:35.552062 27433 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:35.556108 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 27315
I20260811 18:57:35.556229 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-0/wal/instance
I20260811 18:57:35.556468 24459 external_mini_cluster.cc:1428] Setting key 42f83a8e9915a54b7972bf8e296046cf
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:35.563186 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.552754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46727 (local address 127.0.0.1:52890)
0811 18:57:35.552976 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.553019 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.553551 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.553876 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.553879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.554158 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.554314 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.554319 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.555378 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.555379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.556156 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.556159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.556865 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.556866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.556951 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.557455 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.557466 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.559392 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.561551 (+ 2159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.561554 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.561556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.561839 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.562113 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.562114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.562115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.562233 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.562756 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.562762 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.562821 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.562898 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.563027 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":88,"threads_started":1}
I20260811 18:57:35.563315 27440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.552815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52890 (local address 127.23.226.254:46727)
0811 18:57:35.552985 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.552994 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.553119 (+ 125us) server_negotiation.cc:407] Connection header received
0811 18:57:35.553726 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.553728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.553750 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.553871 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.554444 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.555262 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.556344 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.556766 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.556863 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.559489 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.559496 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.559496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.559503 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.561455 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.561935 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.561938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.561938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.562033 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.562336 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.562338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.562338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.562670 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.562782 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.562971 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.563135 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":130,"thread_start_us":78,"threads_started":1}
I20260811 18:57:35.563977 27433 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:35.564373 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.564228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58136)
0811 18:57:35.564286 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.564342 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 18:57:35.564563 27343 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
I20260811 18:57:35.565049 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.564919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58142)
0811 18:57:35.564975 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.565009 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 18:57:35.565255 27433 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:33455: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.23.226.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab.
Entry for principal kudu/127.23.226.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab.
I20260811 18:57:35.587404 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.253:33455
--webserver_interface=127.23.226.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab
--principal=kudu/127.23.226.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:46727,127.23.226.253:33455,127.23.226.252:36655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:35.614557 27433 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } attempt: 1
I20260811 18:57:35.615088 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.614936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58148)
0811 18:57:35.615021 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.615057 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 18:57:35.615482 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.615376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58152)
0811 18:57:35.615427 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.615461 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 18:57:35.615576 27433 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:33455: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
W20260811 18:57:35.676488 27448 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:57:35.676735 27448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:35.676767 27448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:35.676807 27448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:35.677974 27448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:35.678043 27448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:35.678067 27448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:35.678089 27448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:35.678119 27448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:35.679781 27448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:46727,127.23.226.253:33455,127.23.226.252:36655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.253.keytab
--principal=kudu/127.23.226.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.253:33455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.23.226.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:35.680068 27448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:35.680308 27448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 18:57:35.683743 27433 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } attempt: 2
I20260811 18:57:35.684281 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.684107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58162)
0811 18:57:35.684198 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.684239 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 18:57:35.684742 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.684585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58178)
0811 18:57:35.684640 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.684702 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 18:57:35.684868 27433 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.253:33455: Network error: Client connection negotiation failed: client connection to 127.23.226.253:33455: connect: Connection refused (error 111)
W20260811 18:57:35.685299 27457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:35.685292 27458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:35.685410 27461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:35.685776 27448 server_base.cc:1034] running on GCE node
I20260811 18:57:35.686017 27448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:35.686260 27448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:35.687404 27448 hybrid_clock.cc:648] HybridClock initialized: now 1786474655687386 us; error 42 us; skew 500 ppm
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:35.689857 27448 init.cc:377] Logged in from keytab as kudu/127.23.226.253@KRBTEST.COM (short username kudu)
I20260811 18:57:35.690237 27448 webserver.cc:460] Webserver started at http://127.23.226.253:34335/ using document root <none> and password file <none>
I20260811 18:57:35.690469 27448 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:35.690531 27448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:35.690630 27448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:35.691628 27448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/data/instance:
uuid: "af303453e2564cc7b84bd3eab2a40590"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "897a5b475a30c76aa43beeb8658723e9"
server_key_iv: "0af50cea371ad590841cd47d08600694"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.691941 27448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/wal/instance:
uuid: "af303453e2564cc7b84bd3eab2a40590"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "897a5b475a30c76aa43beeb8658723e9"
server_key_iv: "0af50cea371ad590841cd47d08600694"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.693264 27448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 18:57:35.694057 27476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:35.694249 27448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 18:57:35.694365 27448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/wal
uuid: "af303453e2564cc7b84bd3eab2a40590"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "897a5b475a30c76aa43beeb8658723e9"
server_key_iv: "0af50cea371ad590841cd47d08600694"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.694468 27448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:35.707587 27448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:35.709674 27448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:35.709844 27448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:35.714154 27448 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.253:33455
I20260811 18:57:35.714228 27563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.253:33455 every 8 connection(s)
I20260811 18:57:35.714658 27448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/data/info.pb
I20260811 18:57:35.715603 27568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:35.717144 27568 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:35.723627 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 27448
I20260811 18:57:35.723805 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-1/wal/instance
I20260811 18:57:35.724017 24459 external_mini_cluster.cc:1428] Setting key a350716d701aed408e11c4924fad09c3
I20260811 18:57:35.726889 27440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.717914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.23.226.254:46727)
0811 18:57:35.718008 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.718010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.718229 (+ 219us) server_negotiation.cc:407] Connection header received
0811 18:57:35.718757 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.718758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.718773 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.718838 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.719435 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.719942 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.721064 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.721276 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.721336 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.723893 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.723895 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.723895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.723903 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.725355 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.725824 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.725826 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.725826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.725906 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.726210 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.726211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.726211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.726342 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.726396 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.726754 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.726826 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 18:57:35.727175 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.717862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46727 (local address 127.0.0.1:52906)
0811 18:57:35.718090 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.718132 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.718657 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.718891 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.718895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.719147 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.719341 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.719346 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.720116 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.720117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.720976 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.720978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.721365 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.721366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.721486 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.722115 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.722124 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.723798 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.725446 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.725454 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.725457 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.725723 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.725987 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.725988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.725988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.726142 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.726431 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.726437 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.726602 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.726719 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.726891 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":90,"threads_started":1}
I20260811 18:57:35.727716 27568 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.23.226.252@KRBTEST.COM; defaulting to no policy
I20260811 18:57:35.735774 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.727982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58194)
0811 18:57:35.728040 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.728052 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.728099 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.728346 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.728347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.728533 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.728598 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.728600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.729455 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.729456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.730348 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.730351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.730882 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.730883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.730966 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.731320 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.731325 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.732780 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.734686 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.734687 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.734688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.734875 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.735126 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.735126 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.735127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.735192 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.735446 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.735447 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.735486 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.735563 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.735695 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 18:57:35.735976 27573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.728034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58194 (local address 127.23.226.253:33455)
0811 18:57:35.728200 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.728205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.728223 (+ 18us) server_negotiation.cc:407] Connection header received
0811 18:57:35.728250 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.728251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.728262 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.728323 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.728685 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.729362 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.730483 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.730798 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.730858 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.732869 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.732879 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.732879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.732887 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.734600 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.734981 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.734984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.734984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.735043 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.735254 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.735254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.735255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.735385 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.735449 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.735623 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.735773 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":132,"thread_start_us":104,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.23.226.252@KRBTEST.COM" created.
I20260811 18:57:35.736613 27568 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:35.736971 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.736845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55590)
0811 18:57:35.736895 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.736945 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 18:57:35.737162 27481 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
I20260811 18:57:35.737601 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.737495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55606)
0811 18:57:35.737548 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.737575 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 18:57:35.737717 27568 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:36655: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.23.226.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab.
Entry for principal kudu/127.23.226.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab.
I20260811 18:57:35.753391 24459 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMIbuVm/build/release/bin/kudu
/tmp/dist-test-taskMIbuVm/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.252:36655
--webserver_interface=127.23.226.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab
--principal=kudu/127.23.226.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.23.226.212:33289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.23.226.254:46727,127.23.226.253:33455,127.23.226.252:36655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 18:57:35.776043 27433 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } attempt: 3
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:57:35.783259 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.776482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58206)
0811 18:57:35.776553 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.776563 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.776631 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.776805 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.776806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.776974 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.777040 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.777043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.777727 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.777728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.778275 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.778277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.778757 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.778759 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.778841 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.779316 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.779322 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.780548 (+ 1226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.782154 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.782155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.782155 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.782335 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.782584 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.782585 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.782585 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.782652 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.782908 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.782909 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.782961 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.783044 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.783152 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 18:57:35.783259 27573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.776555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58206 (local address 127.23.226.253:33455)
0811 18:57:35.776621 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.776624 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.776635 (+ 11us) server_negotiation.cc:407] Connection header received
0811 18:57:35.776709 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.776710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.776731 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.776797 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.777126 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.777629 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.778368 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.778679 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.778760 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.780640 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.780642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.780643 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.780651 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.782050 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.782454 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.782455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.782456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.782513 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.782725 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.782726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.782727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.782840 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.782917 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.783082 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.783160 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 18:57:35.783891 27433 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:35.784271 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.784168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55618)
0811 18:57:35.784211 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.784236 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 18:57:35.784614 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.784531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55634)
0811 18:57:35.784574 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.784599 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 18:57:35.784749 27433 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:36655: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
I20260811 18:57:35.786929 27568 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } attempt: 1
I20260811 18:57:35.787469 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.787217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55644)
0811 18:57:35.787390 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.787431 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260811 18:57:35.787919 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.787790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55654)
0811 18:57:35.787860 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.787894 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 18:57:35.788095 27568 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:36655: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
I20260811 18:57:35.815922 27433 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } attempt: 1
I20260811 18:57:35.816493 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.816340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55664)
0811 18:57:35.816417 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.816459 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 18:57:35.816872 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.816770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55672)
0811 18:57:35.816820 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.816852 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 18:57:35.816969 27433 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:36655: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
W20260811 18:57:35.841459 27577 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 18:57:35.841722 27577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 18:57:35.841753 27577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 18:57:35.841797 27577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 18:57:35.843022 27577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 18:57:35.843086 27577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 18:57:35.843111 27577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 18:57:35.843132 27577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 18:57:35.843160 27577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 18:57:35.844692 27577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.23.226.212:33289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.23.226.254:46727,127.23.226.253:33455,127.23.226.252:36655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/krb5kdc/kudu_127.23.226.252.keytab
--principal=kudu/127.23.226.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.23.226.252:36655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.23.226.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 17:59:43 UTC on ccycloud.quasar-xuakos.root.comops.site
build id 4581133
I20260811 18:57:35.844980 27577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 18:57:35.845230 27577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 18:57:35.850471 27589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:35.850479 27587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 18:57:35.850517 27591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 18:57:35.850719 27577 server_base.cc:1034] running on GCE node
I20260811 18:57:35.850973 27577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 18:57:35.851308 27577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 18:57:35.852519 27577 hybrid_clock.cc:648] HybridClock initialized: now 1786474655852491 us; error 48 us; skew 500 ppm
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 18:57:35.855257 27577 init.cc:377] Logged in from keytab as kudu/127.23.226.252@KRBTEST.COM (short username kudu)
I20260811 18:57:35.855722 27577 webserver.cc:460] Webserver started at http://127.23.226.252:35873/ using document root <none> and password file <none>
I20260811 18:57:35.855975 27577 fs_manager.cc:359] Metadata directory not provided
I20260811 18:57:35.856050 27577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 18:57:35.856242 27577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 18:57:35.856395 27568 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } attempt: 2
I20260811 18:57:35.856838 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.856712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55678)
0811 18:57:35.856776 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.856811 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 18:57:35.857206 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.857096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55690)
0811 18:57:35.857151 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.857177 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 18:57:35.857298 27568 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.226.252:36655: Network error: Client connection negotiation failed: client connection to 127.23.226.252:36655: connect: Connection refused (error 111)
I20260811 18:57:35.857654 27577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/data/instance:
uuid: "1331a85343d342edb2a89d2aeb107631"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "89e443ee6101f56d795b2874f54746d9"
server_key_iv: "5288a97bedc91b2cd844ec40be6b07d0"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.858049 27577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/wal/instance:
uuid: "1331a85343d342edb2a89d2aeb107631"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "89e443ee6101f56d795b2874f54746d9"
server_key_iv: "5288a97bedc91b2cd844ec40be6b07d0"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.859546 27577 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 18:57:35.860488 27606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 18:57:35.860729 27577 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 18:57:35.860846 27577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/data,/tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/wal
uuid: "1331a85343d342edb2a89d2aeb107631"
format_stamp: "Formatted at 2026-08-11 18:57:35 on dist-test-slave-68xk"
server_key: "89e443ee6101f56d795b2874f54746d9"
server_key_iv: "5288a97bedc91b2cd844ec40be6b07d0"
server_key_version: "encryptionkey@0"
I20260811 18:57:35.860929 27577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 18:57:35.871009 27577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 18:57:35.873174 27577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 18:57:35.873335 27577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 18:57:35.877602 27577 rpc_server.cc:307] RPC server started. Bound to: 127.23.226.252:36655
I20260811 18:57:35.877641 27692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.226.252:36655 every 8 connection(s)
I20260811 18:57:35.878027 27577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/data/info.pb
I20260811 18:57:35.878964 24459 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMIbuVm/build/release/bin/kudu as pid 27577
I20260811 18:57:35.879088 24459 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMIbuVm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786474364687722-24459-0/minicluster-data/master-2/wal/instance
I20260811 18:57:35.879124 27693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 18:57:35.879315 24459 external_mini_cluster.cc:1428] Setting key a3ce69c44b2bdf475371025edf6d6cf3
I20260811 18:57:35.881706 27693 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
I20260811 18:57:35.889982 27440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.882472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52922 (local address 127.23.226.254:46727)
0811 18:57:35.882535 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.882537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.882707 (+ 170us) server_negotiation.cc:407] Connection header received
0811 18:57:35.882740 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.882741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.882752 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.882817 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.883296 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.883741 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.884626 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.884825 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.884881 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.887353 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.887354 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.887355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.887362 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.888650 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.889057 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.889059 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.889059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.889124 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.889374 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.889375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.889375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.889501 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.889573 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.889799 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.889888 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 18:57:35.890187 27698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.882371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.254:46727 (local address 127.0.0.1:52922)
0811 18:57:35.882599 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.882631 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.882693 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.882841 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.882844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.883080 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.883205 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.883208 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.883831 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.883832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.884536 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.884539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.884918 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.884919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.885003 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.885474 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.885490 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.887249 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.888746 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.888754 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.888757 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.888962 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.889204 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.889205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.889205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.889299 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.889577 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.889585 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.889670 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.889763 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.889931 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":142,"threads_started":1}
I20260811 18:57:35.890292 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.879874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55694 (local address 127.23.226.252:36655)
0811 18:57:35.880069 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.880078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.880116 (+ 38us) server_negotiation.cc:407] Connection header received
0811 18:57:35.880761 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.880769 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.880817 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.880933 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.881787 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.883089 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.883921 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.884318 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.884502 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.886920 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.886929 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.886930 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.886937 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.888679 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.889076 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.889079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.889080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.889176 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.889396 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.889397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.889397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.889611 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.889786 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.889841 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.890109 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260811 18:57:35.890923 27693 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:35.892086 27433 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } attempt: 2
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.254@KRBTEST.COM
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.254@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:57:35.899884 27440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.891469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52930 (local address 127.23.226.254:46727)
0811 18:57:35.891509 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.891511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.891517 (+ 6us) server_negotiation.cc:407] Connection header received
0811 18:57:35.891536 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.891537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.891546 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.891600 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.892050 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.892645 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.893530 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.893811 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.893890 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.896794 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.896795 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.896796 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.896804 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.898538 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.898963 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.898966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.898966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.899026 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.899259 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.899261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.899261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.899412 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.899638 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.899684 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.899775 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 18:57:35.899978 27573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.891292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58214 (local address 127.23.226.253:33455)
0811 18:57:35.891341 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.891343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.891351 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:35.891379 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.891380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.891392 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.891448 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.891808 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.892364 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.893134 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.893460 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.893526 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.896352 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.896354 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.896355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.896364 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.898206 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.899011 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.899013 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.899014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.899088 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.899326 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.899327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.899328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.899493 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.899540 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.899784 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.899866 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:57:35.900405 27698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.891188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.253:33455 (local address 127.0.0.1:58214)
0811 18:57:35.891237 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.891248 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.891287 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.891499 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.891500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.891667 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.891724 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.891725 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.892458 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.892459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.893043 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.893046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.893532 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.893533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.893601 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.894111 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.894115 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.896255 (+ 2140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.898511 (+ 2256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.898513 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.898514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.898889 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.899167 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.899168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.899168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.899235 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.899601 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.899602 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.899652 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.900175 (+ 523us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.900293 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 18:57:35.900476 27439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.892299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55706)
0811 18:57:35.892354 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.892367 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.892412 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.892871 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.892872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.893021 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.893056 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.893057 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.894332 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.894333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.894918 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.894920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.895322 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.895323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.895377 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.895817 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.895822 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.897379 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.899327 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.899328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.899329 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.899542 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.899765 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.899766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.899767 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.899833 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.900143 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.900144 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.900195 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.900280 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.900370 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 18:57:35.900776 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.892382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55706 (local address 127.23.226.252:36655)
0811 18:57:35.892759 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.892760 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.892768 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:35.892785 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.892786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.892794 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.892845 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.893588 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.894261 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.895023 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.895248 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.895321 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.897523 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.897524 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.897524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.897532 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.899238 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.899630 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.899631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.899632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.899686 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.899907 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.899908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.899908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.900047 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.900141 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.900607 (+ 466us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.900687 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357}
I20260811 18:57:35.900913 27693 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } has no permanent_uuid. Determining permanent_uuid...
I20260811 18:57:35.902803 27433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb: Bootstrap starting.
I20260811 18:57:35.903596 27433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:35.903890 27433 log.cc:824] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb: Log is configured to *not* fsync() on all Append() calls
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.252@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:57:35.905787 27433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb: No bootstrap required, opened a new log
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.23.226.253@KRBTEST.COM
I20260811 18:57:35.908399 27433 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } }
I20260811 18:57:35.908552 27433 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3495beecc70458795e5da63935217cb, State: Initialized, Role: FOLLOWER
I20260811 18:57:35.908654 27698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.901203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55716)
0811 18:57:35.901323 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.901335 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.901380 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.901494 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.901495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.901641 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.901668 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.901669 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.902709 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.902710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.903395 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.903398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.903889 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.903890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.903949 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.904452 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.904456 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.905616 (+ 1160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.907448 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.907449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.907450 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.907640 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.907864 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.907866 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.907866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.907934 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.908244 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.908245 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.908271 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.908351 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.908490 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260811 18:57:35.908636 27433 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } }
I20260811 18:57:35.908654 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.901289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55716 (local address 127.23.226.252:36655)
0811 18:57:35.901326 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.901328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.901365 (+ 37us) server_negotiation.cc:407] Connection header received
0811 18:57:35.901437 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.901438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.901446 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.901493 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.901760 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.902621 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.903473 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.903801 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.903871 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.905747 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.905749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.905749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.905758 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.907342 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.907721 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.907722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.907723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.907787 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.908014 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.908016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.908016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.908173 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.908210 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.908378 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.908552 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":101,"server-negotiator.queue_time_us":18}
I20260811 18:57:35.909019 27433 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:35.909451 27700 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.909647 27700 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:35.910351 27573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.900678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58220 (local address 127.23.226.253:33455)
0811 18:57:35.901114 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.901117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.901127 (+ 10us) server_negotiation.cc:407] Connection header received
0811 18:57:35.901200 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.901201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.901213 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.901270 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.901901 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.902697 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.903400 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.903734 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.903804 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.906921 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.906922 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.906923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.906931 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.908684 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.909363 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.909364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.909364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.909444 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.909711 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.909712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.909713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.909843 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.910104 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.910160 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.910255 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412}
I20260811 18:57:35.910616 27693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631: Bootstrap starting.
W20260811 18:57:35.911617 27718 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:35.911689 27718 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:57:35.911916 27693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:35.912292 27693 log.cc:824] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:35.912472 24459 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 18:57:35.913367 27693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631: No bootstrap required, opened a new log
I20260811 18:57:35.914544 27385 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f3495beecc70458795e5da63935217cb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52930
I20260811 18:57:35.914670 27385 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 18:57:35.914722 27385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:35.915550 27693 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } }
I20260811 18:57:35.915654 27385 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } }
I20260811 18:57:35.915716 27693 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1331a85343d342edb2a89d2aeb107631, State: Initialized, Role: FOLLOWER
I20260811 18:57:35.915794 27693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } }
I20260811 18:57:35.915884 27385 leader_election.cc:288] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [CANDIDATE]: Term 1 election: Requested vote from peers af303453e2564cc7b84bd3eab2a40590 (127.23.226.253:33455), 1331a85343d342edb2a89d2aeb107631 (127.23.226.252:36655)
I20260811 18:57:35.916121 27693 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:35.916344 27656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f3495beecc70458795e5da63935217cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1331a85343d342edb2a89d2aeb107631"
I20260811 18:57:35.916472 27656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:35.917457 27656 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3495beecc70458795e5da63935217cb in term 1.
I20260811 18:57:35.917789 27343 leader_election.cc:302] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1331a85343d342edb2a89d2aeb107631, f3495beecc70458795e5da63935217cb; no voters:
I20260811 18:57:35.917964 27700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 18:57:35.918110 27700 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [term 1 LEADER]: Becoming Leader. State: Replica: f3495beecc70458795e5da63935217cb, State: Running, Role: LEADER
I20260811 18:57:35.913244 27315 master_runner.cc:186] Error getting master registration for 127.23.226.253:33455: OK, instance_id { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" instance_seqno: 1786474655713003 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:57:35.918229 27315 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:57:35.918205 27700 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } }
I20260811 18:57:35.918354 27721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.918498 27721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:35.918736 27700 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3495beecc70458795e5da63935217cb. Latest consensus state: current_term: 1 leader_uuid: "f3495beecc70458795e5da63935217cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.918839 27700 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:35.919250 27744 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260811 18:57:35.919624 27743 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 18:57:35.919656 27744 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260811 18:57:35.919751 27743 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:57:35.921749 27577 master_runner.cc:186] Error getting master registration for 127.23.226.253:33455: OK, instance_id { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" instance_seqno: 1786474655713003 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 18:57:35.925225 27577 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 18:57:35.927524 27656 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [term 1 FOLLOWER]: Refusing update from remote peer f3495beecc70458795e5da63935217cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:35.927867 27738 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:35.929414 27721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3495beecc70458795e5da63935217cb. Latest consensus state: current_term: 1 leader_uuid: "f3495beecc70458795e5da63935217cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.929539 27721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:35.931478 27573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.919385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58230 (local address 127.23.226.253:33455)
0811 18:57:35.919426 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.919434 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.920427 (+ 993us) server_negotiation.cc:407] Connection header received
0811 18:57:35.920520 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.920522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.920534 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.920569 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.922525 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.923312 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.924936 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.925274 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.925321 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.927172 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.927174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.927174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.927183 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.929441 (+ 2258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.930554 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.930556 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.930556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.930620 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.930861 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.930862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.930862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.931000 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.931085 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.931296 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.931383 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 18:57:35.932994 27700 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f3495beecc70458795e5da63935217cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.933070 27721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f3495beecc70458795e5da63935217cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.933118 27700 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:35.933143 27721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:35.933385 27759 mvcc.cc:205] Tried to move back new op lower bound from 7317400190675951616 to 7317400190641893376. Current Snapshot: MvccSnapshot[applied={T|T < 7317400190675951616}]
I20260811 18:57:35.933776 27761 mvcc.cc:205] Tried to move back new op lower bound from 7317400190675951616 to 7317400190641893376. Current Snapshot: MvccSnapshot[applied={T|T < 7317400190675951616}]
I20260811 18:57:35.939272 27440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.919624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52934 (local address 127.23.226.254:46727)
0811 18:57:35.919671 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.919673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.929263 (+ 9590us) server_negotiation.cc:407] Connection header received
0811 18:57:35.929290 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.929291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.929302 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.929364 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.930199 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.931027 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.933606 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.933961 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.934011 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.935917 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.935918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.935919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.935927 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.937794 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.938269 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.938270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.938271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.938335 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.938593 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.938594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.938594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.938739 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.938833 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.939072 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.939162 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:57:35.940007 27744 catalog_manager.cc:1347] Generated new cluster ID: 31bd4ed0c71b4c7aa51cac2936bb2f4f
I20260811 18:57:35.940063 27744 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 18:57:35.944479 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.920170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55724 (local address 127.23.226.252:36655)
0811 18:57:35.920213 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.920215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.928241 (+ 8026us) server_negotiation.cc:407] Connection header received
0811 18:57:35.928717 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.928719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.928731 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.928764 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.931205 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.931865 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.939192 (+ 7327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.939470 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.939542 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.941191 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.941193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.941193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.941203 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.943084 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.943533 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.943534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.943534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.943600 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.943818 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.943819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.943819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.943960 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.944065 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.944282 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.944375 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 18:57:35.948415 27568 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } attempt: 3
Aug 11 18:57:35 dist-test-slave-68xk krb5kdc[27288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786474655, etypes {rep=17 tkt=17 ses=17}, kudu/127.23.226.253@KRBTEST.COM for kudu/127.23.226.252@KRBTEST.COM
I20260811 18:57:35.956754 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.948668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.23.226.252:36655 (local address 127.0.0.1:55730)
0811 18:57:35.948768 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 18:57:35.948777 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 18:57:35.948812 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 18:57:35.948980 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 18:57:35.948980 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 18:57:35.949149 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 18:57:35.949208 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.949210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.950280 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.950281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.951066 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 18:57:35.951068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.951792 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.951793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 18:57:35.951849 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.952305 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 18:57:35.952310 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 18:57:35.953736 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 18:57:35.955814 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.955815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.955816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.956009 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.956195 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 18:57:35.956196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 18:57:35.956196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 18:57:35.956245 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 18:57:35.956477 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 18:57:35.956478 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 18:57:35.956519 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 18:57:35.956561 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 18:57:35.956652 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 18:57:35.957106 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:35.948776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55730 (local address 127.23.226.252:36655)
0811 18:57:35.948834 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:35.948836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:35.948878 (+ 42us) server_negotiation.cc:407] Connection header received
0811 18:57:35.948899 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:35.948900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:35.948911 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:35.948976 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:35.949283 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.950189 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.951433 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:35.951715 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:35.951997 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:35.953822 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 18:57:35.953823 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 18:57:35.953823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 18:57:35.953830 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 18:57:35.955720 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.956078 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.956079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.956079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.956124 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 18:57:35.956306 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 18:57:35.956306 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 18:57:35.956306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 18:57:35.956417 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 18:57:35.956918 (+ 501us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:35.956956 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 18:57:35.957024 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 18:57:35.958648 27568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590: Bootstrap starting.
I20260811 18:57:35.959445 27568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590: Neither blocks nor log segments found. Creating new log.
I20260811 18:57:35.959813 27568 log.cc:824] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590: Log is configured to *not* fsync() on all Append() calls
I20260811 18:57:35.960781 27568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590: No bootstrap required, opened a new log
I20260811 18:57:35.962169 27744 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 18:57:35.962917 27568 raft_consensus.cc:348] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } }
I20260811 18:57:35.963073 27568 raft_consensus.cc:729] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af303453e2564cc7b84bd3eab2a40590, State: Initialized, Role: FOLLOWER
I20260811 18:57:35.963160 27568 consensus_queue.cc:260] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } }
I20260811 18:57:35.963506 27568 sys_catalog.cc:564] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 18:57:35.963616 27524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [term 0 FOLLOWER]: Advancing to term 1
I20260811 18:57:35.964673 27524 raft_consensus.cc:1261] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [term 1 FOLLOWER]: Refusing update from remote peer f3495beecc70458795e5da63935217cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 18:57:35.964840 27525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f3495beecc70458795e5da63935217cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "af303453e2564cc7b84bd3eab2a40590"
I20260811 18:57:35.964998 27700 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 18:57:35.965065 27744 catalog_manager.cc:1504] Loading token signing keys...
I20260811 18:57:35.965772 27525 raft_consensus.cc:2454] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3495beecc70458795e5da63935217cb in term 1.
I20260811 18:57:35.969561 27790 mvcc.cc:205] Tried to move back new op lower bound from 7317400190675951616 to 7317400190641893376. Current Snapshot: MvccSnapshot[applied={T|T < 7317400190675951616}]
W20260811 18:57:35.970755 27784 catalog_manager.cc:1558] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 18:57:35.970813 27784 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 18:57:35.972003 27789 sys_catalog.cc:455] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3495beecc70458795e5da63935217cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.972179 27789 sys_catalog.cc:458] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:35.972283 27789 sys_catalog.cc:455] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f3495beecc70458795e5da63935217cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.972390 27789 sys_catalog.cc:458] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:35.972590 27768 sys_catalog.cc:455] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3495beecc70458795e5da63935217cb. Latest consensus state: current_term: 1 leader_uuid: "f3495beecc70458795e5da63935217cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.974253 27768 sys_catalog.cc:458] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 18:57:35.974992 27744 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb: Generated new TSK 0
I20260811 18:57:35.975157 27738 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f3495beecc70458795e5da63935217cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3495beecc70458795e5da63935217cb" member_type: VOTER last_known_addr { host: "127.23.226.254" port: 46727 } } peers { permanent_uuid: "af303453e2564cc7b84bd3eab2a40590" member_type: VOTER last_known_addr { host: "127.23.226.253" port: 33455 } } peers { permanent_uuid: "1331a85343d342edb2a89d2aeb107631" member_type: VOTER last_known_addr { host: "127.23.226.252" port: 36655 } } }
I20260811 18:57:35.975265 27738 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3495beecc70458795e5da63935217cb [sys.catalog]: This master's current role is: LEADER
I20260811 18:57:35.975339 27744 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 18:57:36.003388 27440 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.001584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52946 (local address 127.23.226.254:46727)
0811 18:57:36.001634 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.001637 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.002646 (+ 1009us) server_negotiation.cc:407] Connection header received
0811 18:57:36.002762 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.002764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.002777 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.002809 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.003309 (+ 500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52946: BlockingRecv error: recv got EOF from 127.0.0.1:52946 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 18:57:36.004204 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.002007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58242 (local address 127.23.226.253:33455)
0811 18:57:36.002049 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.002051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.003651 (+ 1600us) server_negotiation.cc:407] Connection header received
0811 18:57:36.003755 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.003756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.003768 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.003800 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.004124 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58242: BlockingRecv error: recv got EOF from 127.0.0.1:58242 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 18:57:36.005110 27697 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.002322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55742 (local address 127.23.226.252:36655)
0811 18:57:36.002363 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.002365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.004429 (+ 2064us) server_negotiation.cc:407] Connection header received
0811 18:57:36.004615 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.004617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.004628 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.004660 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.005019 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55742: BlockingRecv error: recv got EOF from 127.0.0.1:55742 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 18:57:36.007946 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.007059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58246 (local address 127.23.226.253:33455)
0811 18:57:36.007109 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.007111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.007356 (+ 245us) server_negotiation.cc:407] Connection header received
0811 18:57:36.007466 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.007467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.007488 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.007518 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.007895 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58246: BlockingRecv error: recv got EOF from 127.0.0.1:58246 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 18:57:36.011593 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.010829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58254 (local address 127.23.226.253:33455)
0811 18:57:36.010864 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.010866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.011099 (+ 233us) server_negotiation.cc:407] Connection header received
0811 18:57:36.011207 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.011208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.011219 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.011247 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.011547 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58254: BlockingRecv error: recv got EOF from 127.0.0.1:58254 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 18:57:36.015538 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.014768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58264 (local address 127.23.226.253:33455)
0811 18:57:36.014801 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.014803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.015039 (+ 236us) server_negotiation.cc:407] Connection header received
0811 18:57:36.015131 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.015132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.015142 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.015185 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.015493 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58264: BlockingRecv error: recv got EOF from 127.0.0.1:58264 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 18:57:36.021431 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.020604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58266 (local address 127.23.226.253:33455)
0811 18:57:36.020642 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.020644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.020891 (+ 247us) server_negotiation.cc:407] Connection header received
0811 18:57:36.020987 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.020989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.020999 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.021028 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.021380 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58266: BlockingRecv error: recv got EOF from 127.0.0.1:58266 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 18:57:36.031569 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.030639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58282 (local address 127.23.226.253:33455)
0811 18:57:36.030678 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.030680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.030948 (+ 268us) server_negotiation.cc:407] Connection header received
0811 18:57:36.031050 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.031051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.031064 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.031094 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.031514 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58282: BlockingRecv error: recv got EOF from 127.0.0.1:58282 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 18:57:36.049901 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.048897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.23.226.253:33455)
0811 18:57:36.048941 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.048943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.049272 (+ 329us) server_negotiation.cc:407] Connection header received
0811 18:57:36.049382 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.049384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.049397 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.049428 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.049839 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58296: BlockingRecv error: recv got EOF from 127.0.0.1:58296 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 18:57:36.084337 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.083326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58300 (local address 127.23.226.253:33455)
0811 18:57:36.083374 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.083377 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.083687 (+ 310us) server_negotiation.cc:407] Connection header received
0811 18:57:36.083797 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.083799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.083814 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.083850 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.084273 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58300: BlockingRecv error: recv got EOF from 127.0.0.1:58300 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 18:57:36.150626 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.149778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58314 (local address 127.23.226.253:33455)
0811 18:57:36.149839 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.149841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.149966 (+ 125us) server_negotiation.cc:407] Connection header received
0811 18:57:36.150053 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.150054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.150074 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.150140 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.150543 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58314: BlockingRecv error: recv got EOF from 127.0.0.1:58314 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 18:57:36.280628 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.279902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58324 (local address 127.23.226.253:33455)
0811 18:57:36.279964 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.279970 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.279997 (+ 27us) server_negotiation.cc:407] Connection header received
0811 18:57:36.280095 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.280096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.280107 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.280155 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.280556 (+ 401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58324: BlockingRecv error: recv got EOF from 127.0.0.1:58324 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 18:57:36.538823 27573 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 18:57:36.537953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58336 (local address 127.23.226.253:33455)
0811 18:57:36.538061 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:36.538063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:36.538076 (+ 13us) server_negotiation.cc:407] Connection header received
0811 18:57:36.538128 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:36.538129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:36.538141 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:36.538209 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 18:57:36.538742 (+ 533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58336: BlockingRecv error: recv got EOF from 127.0.0.1:58336 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 18:57:36.920383 27743 catalog_manager.cc:1259] Loaded cluster ID: 31bd4ed0c71b4c7aa51cac2936bb2f4f
I20260811 18:57:36.920503 27743 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631: loading cluster ID for follower catalog manager: success
I20260811 18:57:36.921419 27743 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631: acquiring CA information for follower catalog manager: success
I20260811 18:57:36.921767 27743 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1331a85343d342edb2a89d2aeb107631: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:57:36.971295 27784 catalog_manager.cc:1259] Loaded cluster ID: 31bd4ed0c71b4c7aa51cac2936bb2f4f
I20260811 18:57:36.971382 27784 catalog_manager.cc:1552] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590: loading cluster ID for follower catalog manager: success
I20260811 18:57:36.972157 27784 catalog_manager.cc:1574] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590: acquiring CA information for follower catalog manager: success
I20260811 18:57:36.972467 27784 catalog_manager.cc:1602] T 00000000000000000000000000000000 P af303453e2564cc7b84bd3eab2a40590: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 18:57:37.054678 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:37.052046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58352 (local address 127.23.226.253:33455)
0811 18:57:37.052217 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:37.052219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:37.052231 (+ 12us) server_negotiation.cc:407] Connection header received
0811 18:57:37.052298 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:37.052298 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:37.052351 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:37.052432 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:37.052575 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.053070 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.053877 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.054068 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.054119 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:37.054288 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:37.054399 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:37.054528 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:37.054591 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 18:57:37.054610 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":74,"threads_started":1}
I20260811 18:57:37.059465 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:37.056646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55748 (local address 127.23.226.252:36655)
0811 18:57:37.056808 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:37.056811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:37.056819 (+ 8us) server_negotiation.cc:407] Connection header received
0811 18:57:37.056865 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:37.056866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:37.056912 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:37.057008 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:37.057142 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.057741 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.058596 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.058841 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.058924 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:37.059091 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:37.059204 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:37.059298 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:37.059345 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 18:57:37.059367 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":80,"threads_started":1}
I20260811 18:57:37.064769 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:37.061206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58356 (local address 127.23.226.253:33455)
0811 18:57:37.061258 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:37.061260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:37.061605 (+ 345us) server_negotiation.cc:407] Connection header received
0811 18:57:37.061690 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:37.061691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:37.061716 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:37.061751 (+ 35us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:37.061932 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.062530 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.063663 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.064068 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.064141 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:37.064424 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:37.064463 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:37.064496 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:37.064649 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 18:57:37.064681 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 18:57:37.065002 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:37.061517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55762 (local address 127.23.226.252:36655)
0811 18:57:37.061558 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:37.061560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:37.061659 (+ 99us) server_negotiation.cc:407] Connection header received
0811 18:57:37.061694 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:37.061695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:37.061705 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:37.061761 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:37.061972 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.062806 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.064079 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.064406 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.064449 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:37.064677 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:37.064730 (+ 53us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:37.064789 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:37.064888 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 18:57:37.064914 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 18:57:37.065193 27903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 18:57:37.061216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.23.226.254:46727)
0811 18:57:37.061368 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 18:57:37.061370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 18:57:37.061473 (+ 103us) server_negotiation.cc:407] Connection header received
0811 18:57:37.061581 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 18:57:37.061583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 18:57:37.061643 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 18:57:37.061754 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 18:57:37.061861 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.062814 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.064025 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 18:57:37.064309 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 18:57:37.064397 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 18:57:37.064602 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 18:57:37.064773 (+ 171us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 18:57:37.064838 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 18:57:37.065055 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 18:57:37.065091 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":95,"threads_started":1}
I20260811 18:57:37.067467 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 27315
I20260811 18:57:37.084230 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 27448
I20260811 18:57:37.094357 24459 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMIbuVm/build/release/bin/kudu with pid 27577
2026-08-11T18:57:37Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3089 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6253 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (292421 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST